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PREFACE 


MARY CATON LINGOLD, DARREN MUELLER, 
AND WHITNEY TRETTIEN 


It is not at all lost on us, the irony of writing a book about the importance 
of digital scholarship. The truth is that the journey that brought us—the 
editors—here began with a simple question: How can scholars write about 
sound in sound? We sensed that the digital turn was an auspicious opportu- 
nity for sonic scholarship—that now, at last, when interrogating matters of 
the audible world it would be easier to incorporate sounds themselves into 
academic argumentation. We imagined multisensory web interfaces that 
would seamlessly embed audio into writing, open access databases full of 
recordings, and experimental sound pieces distributed effortlessly across 
social media. We wanted to breach the cultural impasse and give sound cen- 
ter stage in an intellectually rich digital space. 

These were pipe dreams, but they were also possibilities that we set out 
to pursue in our own creative-critical work. Our big questions led us to the 
proverbial toolshed, where we tried to produce something approaching the 
visionary potential of what we eventually came to call digital sound studies. 
As is often the case, when we looked around to see what other work was 
being done in this vein, we discovered a great deal of innovation occurring 
across multiple fields and in different types of institutions. Scholars were 
composing apps for playing with sound, designing signal processors, pub- 
lishing podcasts, and creating scholarly communities online. Eager to bring 
this work into the conversation, we began by building a digital home for 
experimental scholarship. We solicited provocative work in digital sound 
studies to be part of a custom-built web collection entitled Provoke! Digital 
Sound Studies.* 

Since then, each of us has gone on to produce different kinds of multi- 
modal scholarship. With some input from others, including Darren, Mary 


Caton founded the Sonic Dictionary, a digital collection of audio recordings 
created and curated by students in sound studies courses across institutions. 
She has also collaborated on Musical Passage: A Voyage to 1688 Jamaica, 
which tells the story of some of her research in the form of a digital, audio- 
rich custom website. Whitney is writing a hybrid print/digital book and has 
engineered an innovative journal, thresholds, that presses further against the 
boundaries of scholarly writing and collaboration. At the Eastman School 
of Music, Darren founded the Media, Sound, and Culture Lab as a site for 
faculty and students to explore digital sound scholarship, digital pedagogy, 
and various forms of creative scholarship. An ethos of collaboration is es- 
sential to each of these developing projects, a legacy of our work together 
that initially began in 2011. For us, working closely across disciplinary 
boundaries remains key to the advance of scholarship on and off the page. 

In fact, it was our work on Provoke! that revealed to us the necessity of this 
book. Each medium offers its own capacities—affordances, in the digital 
parlance—and individual projects by themselves only tell part of the story. 
A great deal of intellectual labor went into the composition and creation of 
Provoke! and the individual projects featured there. To substantiate and make 
legible the productive modes of thought driving digital sound studies, a 
much broader, more in-depth conversation needed to take place. This is just 
the sort of thing that books—and especially collections that feature mul- 
tiple voices bound together with a single vision—can accomplish. Digital 
humanities praxis is made possible by the modes of intellectual inquiry and 
argumentation that humanists are well trained for. But this book shows that 
the opposite is also true: that born-digital scholarship generates rigorous 
intellectual inquiry of the sort well suited to the long-form essay. Identify- 
ing and bearing out the fruits of the deeply entangled relationship between 
these two forms of composition is what this collection sets out to do. 

Sound productively unsettles many of our ingrained assumptions about 
the limitations and possibilities of both print and digital authorship. For 
instance, books can seem frustratingly silent, but as any good reader knows, 
they can communicate sound quite effectively. In contrast, digital media 
feels like a natural home for audio, but designing for sound on the web can 
be challenging. This is why we need to bring the insights of sound studies 
to bear upon the emergent field of digital humanities. By provoking both 
fields toward an experimental and soundful engagement with one another, 
we envision digital sound studies will become an interdiscipline born at the 
intersection of analysis and innovation. 

The contributors in this book practice critical listening to reveal the role 
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of sonic life in digital spaces. They also model how to use digital methods 
both to enhance the study of auditory culture and, literally, to amplify sound 
in the academy. This book is therefore for sound studies scholars who wish 
to understand how digital humanities methods might enhance their own 
research, and it is for digital humanists who seek to enrich their work with 
sound. It is also for students and scholars across disciplines who are strug- 
gling to make sense of the digital turn and its impact on scholarship, the 
classroom, and wider publics. To seize this moment is to embark on a great 
experiment, one with upsides and downsides. Not all digital sound schol- 
arship will be transformative. But by being provocative—by giving voice 
to thought—digital sound studies creates the possibility for new kinds of 
understanding that can do justice to forms of sonic knowledge: the ancient, 
the fledgling, the yet-to-be imagined. 


NOTE 


1 Provoke! can be accessed at http://soundboxproject.com, or https://doi.org/ 
10.7924/G8H12ZXR. 
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INTRODUCTION 


MARY CATON LINGOLD, DARREN MUELLER, 
AND WHITNEY TRETTIEN 


Cats meow over the whir of cars passing by. A grainy shuffling, 
barely distinguishable from the hiss of the tape, echoes in an 
apartment before two distinct thumps overwhelm the mix. A floor 
creaks in the distance; a whistling sigh sounds as a bus driver 


lifts a foot from the brake. 


It was fall 2011 and the three of us were crowded around a laptop, listen- 
ing. The recording we heard came from the Jazz Loft Project, a collection of 
digitized audio captured by photojournalist W. Eugene Smith between 1957 
and 1965. An obsessive sound collector, Smith left his reel-to-reel recorder 
running nonstop in his rundown New York City loft. Offering more than 
four thousand hours of audio, the collection is prized for including rare jam 
sessions with jazz greats like Thelonious Monk, Sonny Rollins, and Charles 
Mingus. In addition to documenting an iconic era in jazz, Smith recorded 
all kinds of ephemeral sounds: snippets of phone conversations, fragments 
of radio and television broadcasts, the roar of buses driving past the loft. 
This important collection of reel-to-reel tapes was recently digitized and 
housed on 5,087 cps thanks to the work of documentarian Sam Stephen- 
son. We wanted to learn more about the process of digitizing a massive 
collection of audio recordings, so we were meeting with the archive’s cata- 
loger, Dan Partridge, who had just played us the clip.* 

“It took me weeks,” he admitted, “but I finally figured out what those 
thumps are. It’s Smith’s cats, playing with the microphone.” Dan spent his 
days in a quiet basement, his ears locked under headphones, listening to 
the recordings on a computer. As he listened, scrubbing the audio back and 
forth to hone in on particular noises, his ears became attuned to what he 
was hearing, and he began to develop a mental map of the acoustic space 
in Smith’s loft. Eventually he could interpret sounds that would be unin- 


telligible to a casual listener—understanding indistinct commotion, for 
instance, as a cat jumping onto a table. Once he had identified the content 
of a recording, Dan would scribble down his observations on paper. These 
handwritten notes were then logged in a spreadsheet. Dan’s descriptions 
are now part of the collection’s finding aid and thus render an impenetrably 
large amount of audio data accessible to researchers. 

If we were asked to point to a project that demonstrates the potential of 
digital media to improve sound-based research, we might well suggest the 
Jazz Loft Project. Yet, as we learned that day in the basement, nothing about 
realizing the transformative potential of digital scholarship is as straight- 
forward as it might seem. 

Take, for instance, the very notion of “digital media.” Sitting between 
a cabinet of CDs, a box of reel-to-reel tapes, a pile of handwritten notes, 
and a computer screen displaying a spreadsheet, we confronted a tangle of 
technologies knit together in ways far more complex than the simple mod- 
ifier “digital” would indicate. Dan was listening to CDs that store digitized 
copies of Smith’s original reel-to-reel recordings, but since each format 
encodes sonic data differently, the timestamps on the tapes do not corre- 
spond precisely to those on the cDs; what is halfway through the first reel 
may come at the beginning of the fourth cp, for instance. Moreover, even 
though the audio data on the cD is “digital,” it was at that point still locked 
on physical media in a basement cabinet. Listening to a particular sound 
would require finding not only the right cp buta cD player—an increasingly 
rare bit of technology. While in theory, then, digital copies are more manip- 
ulable and “spreadable” than their analog counterparts, in practice they are 
no more accessible to the average listener than reel-to-reel tapes. From the 
researcher’s perspective, this shift from one platform to another currently 
signals little more than a loss in fidelity for the Jazz Loft Project. 

It is, of course, technologically possible to rip data from the cDs and 
post the clips online for streaming, assuming one has access to the right 
software and a server. Yet, again, what is technologically possible is not so 
easily realized in messy reality, especially when multiple institutions have 
investments in the material. A knot of competing copyright claims leave 
the digital collection in legal limbo: the musicians (or their estates) claim 
the rights to their performances; Smith’s estate has claim to the reel-to-reel 
tapes, which live at the University of Arizona; while Duke University owns 
the digitized copies on the cDs. Streaming an audio archive for educational 
purposes would seem to fall under “fair use” in the United States, but the 
courts have interpreted this exception narrowly for audio recordings, and 
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indeed what counts as an “educational purpose” is largely untested when 
it comes to sound. Moreover, the length of copyright protections—seventy 
years after the author’s death—means that, realistically, much of the mate- 
rial in the Jazz Loft Project may not be available to the public for decades. And 
that’s just the situation in the United States. It is often unclear what rights 
and responsibilities attend to an individual accessing U.S.-copyrighted ma- 
terials for educational purposes from a physical location that is outside of 
the United States. Thus, outdated and ambiguous laws continually hamper 
the use of digital sounds in humanities research and teaching. 

Even if the Jazz Loft Project were somehow able to overcome these seem- 
ingly insurmountable technological, institutional, and legal hurdles and 
could post the entire collection online for free public streaming, visitors 
would still face the challenge of finding discrete sounds and clips within 
four thousand hours of audio. Which is to say the collection is all but useless 
to researchers or even casual browsers without the textual metadata that 
Dan Partridge authored. Only through the intermediary of his knowledge 
and time—the hours he spent retuning his ears to the pitch of Smith’s 
loft—did uninterpreted noise become keyword-searchable as the voice of 
Charles Mingus or a radio broadcast. Using pattern recognition to automate 
these search and discovery tasks in large corpora of audio is an active field 
of research, and it is possible that one day artificial intelligences will be 
able to take over for Dan, identifying Mingus’s voice with minimal human 
intervention. For now, though, this labor is performed with human wet- 
ware, usually by a single cataloger (or a small group of catalogers) whose 
intellectual frameworks, interests, and knowledge of the subject shape the 
metadata and thus influence what type of research the collection supports. 
While digital media thus create a space of possibility for the study of sound, 
critical, interpretive labor fulfills this potential, not the technology itself. 

As the Jazz Loft Project demonstrates, the humanities are in a moment of 
transition: between analog and digital; between the “old” methods and the 
“new”; between potential for change and the structures that hold it back. 
On the one hand, it has never been easier to build and access sonic archives 
or incorporate sound into scholarship. On the other, the ease with which 
sonic or audiovisual work can be shared and produced does not mean that 
academic writing, publishing, graduate training, or tenure and promotion 
have caught up with the possibilities. And so we—scholars of sound and 
technology—find ourselves at a crossroads. This book dwells in these var- 
ious interstices as both a testament to the transformative value of experi- 
menting with digital tools and a reinvestment in interpretive practices that 
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always attend to the human. As our contributors demonstrate, amplifying 
the humanities through digital scholarship does not oppose close listening 
and deep historical analysis. Rather, these humanistic modes of interpreta- 
tion provide the very foundation of digital sound studies. 

The scratching and thumping that begin this essay perfectly encapsulate 
these tensions. When the cats batted Eugene Smith’s microphone so many 
decades ago, the sounds that resonated in his loft were not the same as the 
commotion that we hear in the recording. Rather, they are “artifacts” of 
the technology itself: anomalies in the signal that draw our attention to the 
network of wires, transducers, and magnetic tape that enabled audio repro- 
duction. By making audible the systems that are designed to be invisible—by 
letting us hear the presence of the microphone in the room—such glitches 
document the material conditions that make recording possible. The design 
of the microphone, its placement in Smith’s loft, the nature of how those 
magnetic tapes encode and store sonic information, the altered nature of 
that information once it is digitized: these structures all shape sonic expe- 
rience, whether we acknowledge them in our scholarship or not. This is true 
now more than ever, as digital technologies become both more ubiquitous 
and more entangled. Studying sound in the second decade of the twenty-first 
century demands that researchers pay critical attention to technologies, and 
especially to their invisibilities and silences. 

No scholars are better placed to critically interpret, historicize, and seize 
the potential of the epistemological shifts brought about by the digital era 
than those who can interpret the cats’ improvisational performance. The 
tools we use to listen to and reproduce sound are changing—along with 
forms of authorship and critical inquiry—and this book provides a blueprint 
for making sound central to research, teaching, and publishing practices. 
Using sound in one’s work is not only imminently doable for humanities 
scholars today, itis, as this volume argues, urgently necessary. Digital sound 
studies holds the possibility of changing the text-centric and largely silent 
cultures of communication in the humanities into more richly multisensory 
experiences, inclusive of diverse knowledges and abilities. 


Scholars have been carving out space for what we call digital sound studies 
for decades. Challenging the humanities to listen more closely—to attend, 
that is, not only to what but also to how we hear—sound studies scholars 
have productively theorized the sonic technologies that mediate and con- 
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struct our experiences.” This growing body of research has taught us that 
sound has a politics; it can be gendered and racialized, used both to liberate 
people from and reinscribe determinative social categories. Sound has ethi- 
cal implications and can help to build community or, conversely, to torment 
prisoners. It can elicit fear as easily as it produces longing or nostalgia. Even 
what counts as “sound” or “signal” and what gets dismissed as “noise” can 
differ dramatically across listening practices and auditory cultures.* Sound 
studies, then, places sounds in their cultural, historical, and social contexts. 
Dealing with the production, distribution, experience, poetics, or historici- 
zation of sound, as sound scholars have done, means dealing with the lived 
experiences of people. 

One field has acknowledged the political complexity of sound since its 
inception: black studies. Generations of black cultural critics and authors 
have drawn deeply from music and sound in their writing. For instance, 
W. E. B. Du Bois frames each chapter in his classic Souls of Black Folk (1903) 
with excerpts from spirituals, which he theorizes as “sorrow songs” central 
to the African American experience.* Black studies has also had to confront 
sonically encoded racist stereotypes, such as those made popular in the 
United States through blackface minstrelsy and the use of “negro dialect” 
in early radio and television.’ As a result scholars in the field have long been 
well attuned to the complex cultural significance of sound.‘ More recently, 
work at the intersection of sound studies and black studies has turned to 
technology to reveal its mediating effect on black aesthetic traditions. Fred 
Moten, for example, attends to the way the recording studio filters the phil- 
osophical conception of blackness in the work of Marvin Gaye.’ Scholarship 
centered on popular music similarly assumes a form of culture making via 
technological reproduction, as can be seen in the work of Alexander Wehe- 
liye, Mark Anthony Neal, and Daphne Brooks. In other cases, technology 
takes a more central role, as with Louise Meintjes’s view of urban recording 
studios in South Africa that depicts the negotiation between races and 
ethnicities created by apartheid. In this multidisciplinary body of work, 
scholars have shown that sound can serve many purposes: it can mobilize 
resistance, be a tactic of social negotiation, or contribute to structures of 
oppression and racialized representation. 

The emergence of mechanical audio reproduction inspired scholars 
working within multiple fields to consider the social effects of mass dis- 
tribution. This is especially true of cultural studies, where the technologi- 
zation of sound was explored by many foundational theorists in the early 
to mid-twentieth century: Theodor Adorno, Walter Benjamin, and Roland 
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Barthes were followed by early media historians such as Walter Ong and 
Marshall McLuhan.” For these thinkers, the advent of new audiovisual 
technologies—the phonograph, film, radio, and eventually television— 
presented an opportunity to reconsider the relationship between technolog- 
ical and cultural production. Their work explores how the seemingly anti- 
human world of machines produces the modern political subject, extends 
the human body, and splits sounds from their sources, especially the human 
voice.’ Some feared technology more than others. For instance, whereas 
Adorno (and later Jacques Attali) feared mass media’s effect on culture, 
Benjamin seized on the power of the new medium of radio to disseminate 
ideas to the public, producing between eighty and ninety popular broad- 
casts on topics as wide-ranging as urban archaeology, literary tropes, and 
ancient history.** McLuhan, too, embraced popular media, making a cameo 
appearance in Woody Allen’s Annie Hall. By treating audiovisual culture as 
a function of its technological reproduction, these early theorists laid the 
groundwork for the emergence of media and communication studies in the 
second half of the twentieth century. 

A later generation of media scholars challenged the Marxian, modernist 
skepticism of technology that undergirds so much of this early work on the 
reproduction of sound. Technology is not non- or antihuman, they argued, 
but rather is always both producing and produced by human culture. That 
is, our listening practices are a product of the technologies that frame them, 
as much as the designs of our devices are shaped—literally—by the human 
body and the ways it listens.*? Jonathan Sterne makes this point forcefully in 
The Audible Past, where he authors a cultural history of sound reproduction 
that upsets what he terms the “audiovisual litany”’—the idea that sound 
and sight are mutually exclusive senses.** Other authors also explore the 
interconnectedness of sound, listening bodies, and technologies. Emily 
Thompson, writing about urban soundscape in the early twentieth century, 
reveals how mastery over sound in concert halls, churches, offices, and 
Hollywood soundstages was a cultural problem that sought technological 
solutions from the burgeoning field of acoustical science.** Lisa Gitelman 
attends to ways in which sound is always linked to multiple modes and me- 
dia, showing the foundational role that visualist and tactile practices like 
reading, writing, and inscription played in the design of Edison’s phono- 
graph.’ Together, this generation of media studies scholars reveals how the 
history of sound technology is always knit to the creation, production, and 
distribution of cultural memory and to the spaces of work, entertainment, 
and family.” 
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The wide-scale adoption of digital technologies at the end of the twen- 
tieth century brought a new set of concerns to the emerging field of sound 
studies, especially for those scholars who focus on music. Mark Katz and 
DJ Spooky, for instance, have situated seemingly “digital” practices like 
sampling within longer histories of sonic production, demonstrating the 
continuity between past and present. Others, especially Tara Rodgers, 
have convincingly pushed for more inclusive histories of electronic music 
and the sound arts that include the contributions of women and people of 
color to the development of digital audio techniques.” Playback devices and 
instruments have been of particular interest, and Michael Bull’s work on 
the iPod, Paul Théberge’s work on synthesizers, and Mack Hagood’s work 
on noise-canceling headphones elucidate how digital technologies mediate 
our relationship to sonic space in new ways.” Within and alongside research 
on digital music has flourished a renewed interested in materiality within 
media studies, especially the layered relationships between platforms, 
interfaces, and digital file formats.” Together, these digitally inflected ap- 
proaches to sound ask media and digital studies scholars to think across 
software and hardware, and across forensic and formal materialities, and 
to continue to attend to the social and the cultural. 

The fields of ethnomusicology, anthropology, and folklore also have their 
own longand storied relationship with technologies of sound. In the first half 
of the twentieth century, researchers in these nascent disciplines pioneered 
the use of portable recording equipment for collecting vernacular music.” 
The scripts they created for preserving sonic life influenced documentarians 
like Eugene Smith and survive today in the methods many ethnographers use 
to record their research in “the field.” Early on, recording technology seemed 
to provide an efficient means to a noble end—preserving and venerating 
cultural forms that had previously been ignored. Over the years, however, 
it became clear that recording devices are not neutral mechanical objects: 
they play an agentive role in what is often a hierarchal encounter between 
researcher and subject. For instance, many prominent twentieth-century 
sound collectors were white scholars in positions of power making a living 
off of performances by rural, indigenous, and black and brown musicians.”* 
In their recent returns to the early history of sound-based research, scholars 
Erika Brady, Benjamin Filene, Karl Hagstrom Miller, and others have illumi- 
nated the profoundly politicized nature of recording technologies as well as 
their lasting impact on the formation of academic fields, the music industry, 
and the preservation of vernacular culture in museums and archives.** Here, 
Steven Feld has been an innovator, composing soundscapes alongside more 
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traditional print monographs to make explicit the way in which his own field 
recordings were always aesthetically manipulated.” 

Because of the fraught histories of early sound collections, many of the 
institutions now housing them are grappling with how to preserve this 
material equitably in an era of mass digitization. Archivists and scholars 
—including Diane Thram, Sylvia Nannyonga-Tamusuza, Andrew N. Wein- 
traub, and others—are asking what it might mean to repatriate digital sonic 
artifacts to their communities of origin.” Digitization would seem like a 
promising way to ensure that communities have access to their cultural 
heritage, but because reliable internet is a rare and costly commodity in 
many parts of the world, and especially in the global South, transmitting 
data online is untenable.” Furthermore, the history of economic exploita- 
tion surrounding much of this material means that some communities may 
not want their sonic artifacts to be widely available online. The U.S.-based 
Radio Haiti Archive is experimenting with disseminating digitized record- 
ings from its collection to institutions and people in Haiti using USB sticks, 
a method of media transfer popular in areas where internet downloading 
and streaming are logistically difficult.** In an era when the vast majority 
of scholars are using digital devices on a regular basis, it is more important 
than ever to heed the lessons from our predecessors and carefully consider 
the ethical implications of seemingly benign technologies. For digital sound 
scholars, this means being particularly cognizant of the fact that internet 
access does not equate to universal access and being mindful that issues of 
power and publicity remain fraught. 

As scholars of sound increasingly confront digital technologies, we find 
ourselves in conversation with digital humanities. Like sound studies, this 
interdisciplinary network encompasses a wide range of theories and prac- 
tices loosely bound together by an interest in digital tools and technologies. 
On one end of its spectrum, critics such as Richard Grusin, Grant Wythoff, 
and others focus on culture and theory, drawing on methods from media 
and film studies to narrate the deep histories and philosophical implica- 
tions of new technologies. Alex Galloway has clearly articulated the moti- 
vation behind such work in a recent interview with Melissa Dinsman: “The 
humanities needs to stop thinking of computation as an entirely foreign 
domain, and instead consider computers to be at the heart of what they have 
always done, that is, to understand society and culture as a technical and 
symbolic system.” Others within digital humanities take a more hands-on 
approach by building digital tools and platforms for humanities research. 
This work often emerges from lab-like research environments and includes 
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projects such as Omeka, a curation platform for the web built at George 
Mason University’s Roy Rosenzweig Center for History and New Media; 
Voyant Tools, a web-based text analysis platform built in collaboration 
between scholars at McGill University and the University of Alberta; and 
experimental text-visualization tools like Juxta and Ivanhoe, built at the Uni- 
versity of Virginia’s Institute for Advanced Technology in the Humanities. 
A particularly vibrant subfield of work right now, which can go by the name 
text mining or culturonomics, uses “big data” to analyze large bodies of 
text, image collections, and even audiovisual materials.” 

At some moments these various strands of digital humanities have been 
antagonistic, and even the term “digital humanities” has created contro- 
versy. Some worry that the field has a far too comfortable relationship with 
systems of power that cultural criticism has long sought to challenge.” 
The scarcity of funding often exacerbates such tensions, especially in an 
era when the humanities are facing institutional pressure and falling en- 
rollments. However, the digital turn has also reinvigorated conversations 
around the importance of humanities research and the often underappreci- 
ated, if not invisible, institutional structures that make our fields possible. 
For instance, digital humanities serves as a point of intersection between 
librarianship and scholarship, and libraries have become the de facto home 
for digital research on many campuses. These collaborations have led to the 
development of electronic collections that bring long-neglected authors and 
underrepresented histories to the public eye.” They have also galvanized 
discussions around the politics and long-term preservation of data in the 
humanities while advancing the cause of open access.” Publishing, too, 
has served as a point of intersection between different strands of work, as 
stakeholders across the humanities work together to develop digital plat- 
forms that speed up publication timelines and develop new protocols for 
peer review.** While the expansiveness of digital humanities, both as a field 
and as a “tactical” term that enables humanists to secure funding, has made 
it notoriously difficult to define, practitioners across all fields of study share 
an interest in exploring how digital media are transforming humanistic 
research.” 

If sound studies and digital humanities have been confronting similar 
questions about praxis in the humanities and the nature of critical method, 
one might reasonably ask: Why has there been so little interest in sound 
within digital humanities? One answer lies in the text-centricity of the field, 
a bias that is baked into its institutional history. As a discipline, digital 
humanities locates its origin in Father Roberto Busa’s Index Thomisticus, 


INTRODUCTION : 9 


a concordance of every word in the works of Thomas Aquinas built using 
punch-card computing.*° Its earliest journal is Literary and Linguistic Com- 
puting; among its earliest projects are electronic editions of literary works, 
leading to the formation of the Text Encoding Initiative (TEI) in the 1980s.’ 
Digital humanities scholars generally communicate on Twitter and via long- 
running, heavily curated listservs like the Humanist rather than podcasts, 
favoring reading and typing over listening and speaking. While the early 
decades of the twenty-first century have seen the field expand significantly, 
including the creation of a new “AudioVisual Materials” Special Interest 
group of the Alliance for Digital Humanities Organizations, sound remains 
perhaps the least utilized, least studied mode within digital humanities. 
Few projects and fewer tools incite scholars to listen. 

Yet this bias against sound is also a function of the nature of digital 
information itself. From the earliest days of personal computing, users 
interacted with machines through typed instructions issued through the 
command line. Vestiges of this interface are present in the ubiquitous 
search box of the web, where all content is parsed as a string of characters. 
Dependence on text within digital spaces persists in the user tagging that 
makes sound searchable on sites like SoundCloud and Genius, as well as in 
the more formal textual markup structures used to describe and organize 
digital content in projects like the Jazz Loft Archive. Simply put, making 
audio content accessible means rendering it as text. Even at its most abstract 
level, digital technology is built on a binary structure that mediates all data 
through strings of characters, which are then manipulated using text-based 
instructions. Thus even as we tend to imagine digital technologies as in- 
finitely flexible, their fundamental unit is the discrete mark, the physical 
trace identified visually. This simple fact has given rise to a visualist orienta- 
tion that continues to plague screen culture. 

The silence of digital platforms has broader implications for teaching 
and research. Though rarely described as such, the sonic culture of the acad- 
emy has always shaped what it is possible to know and to communicate. 
Many of the academy’s most sacred practices involve the entanglement of 
text and oral performance, such as the dialogic and Socratic methods of 
lectures, conference papers, and colloquium presentations. Classrooms 
and seminars are inherently noisy spaces where students voice opinions, 
tap keyboards, and flip the pages of books. As much as focused study seems 
to be silent, the oral and the aural never recede from academic practices. 
Some digital platforms, like video conferencing, have amplified these as- 
pects of academic communication, enabling scholars and students to speak 
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across vast distances. Others silence our interactions. For example, many 
humanities scholars have criticized online learning for commodifying the 
education process, but collectively we must also recognize the impact of 
these changes on sensing bodies. Digital learning environments transform 
noisy spaces to silent screens, where students interact with their instructors 
and classmates almost entirely via written language. The proliferation of 
silence via text-oriented digital technologies affects individual learners and 
educators differently. 

What forms of knowledge—and what embodied experiences—are dimin- 
ished by the humanities’ reliance on text and visualist methods? And whose 
voices are going unheard in the digital turn? Bringing sound studies into 
meaningful conversation with digital humanities has the power to inspire 
new questions and foment new methods that are radically different from 
those of print. By foregrounding sonic experience, this collection begins an- 
swering these questions, using auditory culture to probe the assumptions of 
digital tools and technologies in academic life. Engaging deeply with sound, 
as our contributors collectively argue, untethers scholars from their reliance 
on text-based modes of knowledge, revealing the structural biases built into 
the apparatus of scholarship and transforming the epistemic grounds upon 
which such conversations can be had. 

Publishing venues and researchers are already challenging the biases of 
the contemporary media environment through multimodal scholarship. A 
variety of journals including Kairos, Liminalities, and Computers and Composition 
Online, blogs like Sounding Out!, and platforms such as Scalar have created 
venues for born-digital work that encourage exploration and experimenta- 
tion while building on established traditions of academic writing and argu- 
mentation.” The creative use of new media is at play in a number of projects 
that combine audio with a wide range of digitally archived material. Sharon 
Daniel’s “Public Secrets” is an interactive (and intentionally public) audio 
archive of interviews with incarcerated women who pointedly describe 
the prison industrial complex and its injustices.” The historically focused 
Freedom’s Ring, a product of the Martin Luther King, Jr., Research and Edu- 
cation Institute at Stanford University, mirrors the audio from King’s iconic 
“I Have a Dream” speech with his written draft so that users experience both 
versions of the speech simultaneously. An “index” links this audiovisual 
rendering of King’s speech to a number of digitized archival documents 
relevant to the performance and its political moment.*° Similarly, Emily 
Thompson’s “The Roaring Twenties,” a complement to her monograph The 
Soundscape of Modernity, employs New York City noise ordinances in the 1920s 
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to explore everyday contestations of the urban soundscape.* These inno- 
vative projects create reading and listening experiences that give agency to 
the user, thereby challenging the unidirectionality of conventional scholarly 
writing. It is also significant that each project was created collaboratively: 
Freedom’s Ring was developed under the direction of Evan Bissell in part- 
nership with Beacon Press’s King Legacy Series and the MLK Institute at 
Stanford; Thompson’s with the help of web designer Scott Mahoney; and 
Daniel’s with support from the design team at Vectors journal. Like much 
digital humanities work, digital sound studies is changing the model for ac- 
ademic production by moving away from single-authored, single-argument 
work toward collaborative, multimodal projects that allow for multiple 
pathways and target broad audiences. 


This volume cuts across the wide-ranging disciplines engaged in sound- 
based research, encompassing literature, performance, disability, anthro- 
pology, black studies, history, information science, and more. However, the 
contributors refrain from engaging solely in field-specific debates, speak- 
ing instead to the broader issues, opportunities, and challenges that emerge 
from thinking about and with sound in digital environments. Part 1, “The- 
ories and Genealogies,” lays the historical and conceptual groundwork for 
this exploration by linking digital sound studies to important shifts in aca- 
demic thought and practice that took place in the twentieth century. Histo- 
rian Richard Cullen Rath narrates the history of his encounters with digital 
methods, beginning with his experiences as a student. For more than two 
decades he has studied a rare historical document of African-diasporic mu- 
sic in Jamaica. An early adopter of MIDI technology, over the years Rath has 
combined digital and analog methods to create playable historical replicas 
of instruments and to interpret the music. This essay meditates on the im- 
portance of digitally informed “ethnohistory” for illuminating the cultural 
contributions of enslaved Africans and subaltern histories. 

Myron Beasley anchors digital sound studies praxis in the critical moves 
of black radicalism and embodied performance. In an engaging narrative 
that unfolds like tracks on an album, Beasley draws on Zora Neale Hurston’s 
work to show how her innovative uses of technology to record folk culture 
in her native Florida connect to the performance of a Dy sampling her voice 
on a laptop in a Harlem cafe. Beasley also explores the politics of metadata 
and the problems caused by the way archives misrepresent Hurston’s schol- 
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arship by identifying her work with her white male colleagues. This chapter 
thus narrates a genealogy of digital sound studies rooted in black feminist 
theory, performance, and ethnographic practice. Through an exploration of 
Walter Ong’s theories of orality and rhetoric, Jon Stone’s essay also explores 
how sound often operates as the connective tissue at this particular mo- 
ment of technological hybridity when the term “digital” signals work that is 
participatory, spontaneous, and often noisy. The essay begins with Stone’s 
encounter with a single digital sound object: a YouTube video of CHOIR! 
CHOIR! CHOIR! (anad hoc vocal ensemble in Toronto) performing Phil Col- 
lins’s “In the Air Tonight.” Stone riffs on the digitally mediated performance 
to introduce what he calls “digital humanity”—the connective potential of 
today’s technologies. 

Stone’s essay delivers readers to part 2, which highlights the way schol- 
ars are using social media and digital pedagogy to build communities of 
thought around sonic research. The editorial team behind the Sounding Out! 
blog single-handedly transformed the look, feel, and sound of contempo- 
rary sound studies by instigating a conversation online that unites a wide- 
ranging field. Importantly, they have brought voices from the margins into 
the center by curating and promoting sound studies work through the site’s 
social media presence. In their essay, Aaron Trammell, Jennifer Stoever, 
and Liana Silva examine the affective labor entailed in the act of building a 
strong digital community and provide a biography of their project. Regina 
Bradley’s series of YouTube interviews about the significance of the music 
group OutKast similarly shifts the conversation in her field to be more in- 
clusive of regionalisms of the American South in the study of hip-hop. She 
reached new public and academic audiences while building a multimedia 
archive of cultural criticism. In her essay, she documents the intellectual 
outcomes of this work and creates a template for others wishing to embark 
on a similar method of digital sound research and publication. W. F. Umi 
Hsu brings this ethos of community building to the classroom, where they 
ask their students to engage in audio-ethnography in collaboration with lo- 
cal middle schoolers. By producing sound recordings in collaboration with 
community partners, Hsu’s students learn that sonic methods can challenge 
hierarchies and build bridges across cultures and generations. Hsu explores 
their students’ insights and experiences to demonstrate that turning to 
sound amplifies the already transformational aspects of digital pedagogy. 

Each of the scholars in part 3, “Disciplinary Translations,” traverses 
boundaries to build new conceptual frameworks for digital sound stud- 
ies. In her essay, Tanya Clement explains that the metadata conventions 
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of information science create significant barriers for data-driven digital 
sound scholarship. Clement is the principal investigator of the NEH-funded 
project High Performance Sound Technologies for Access and Scholarship 
(HiPSTAS), which aims to harness the capacity of big-data analytics for the 
study of spoken-word audio collections. Clement’s investigation is crucial 
for securing the potential for digital sound studies to enhance the research 
potential of large audio collections through innovative computational anal- 
ysis and discovery. Yet her observations remain rooted in practices of close 
listening that attend to the nuances of sonic meaning in cultural life. 

Michael Kramer takes aim at the frustrating ubiquity of visualization 
techniques in digital humanities by flipping the script and remediating 
visual media such as maps and photographs as sonic data. His avant-garde 
methods of “sonification” demonstrate that sound-based research can be 
meaningful for scholars working with visual culture. A historian by train- 
ing, Kramer listens to seemingly “silent” visual artifacts from the historic 
Berkeley Folk Festival archive, showing how to interpret the sounds encoded 
in images through a deeply multimodal praxis. Trained in literary studies, 
and a researcher of Victorian music, Joanna Swafford shows how digital 
methods enable her to present her work to different disciplines. Faced with 
the challenges of writing about the nuances of musical notation for a lit- 
erary audience, she designed an open-source tool, Augmented Notes, that 
makes it possible for people who do not read music to learn more about the 
relationship between musical scores and performance. Her digital solution, 
however, has multiple potential applications that may be used across fields 
to animate notational music for a variety of purposes. 

Part 4 “Points Forward” to the next wave of digital sound scholarship by 
identifying key challenges that the field needs to address. Digital humanists 
are just beginning to develop methods of assessment and evaluation that 
recreate the rigor of peer review, a practice not without its own critics. 
Rebecca Geoffroy-Schwinden identifies what makes digital scholarship 
about historical sounds effective while reviewing key projects that examine 
the cultural history of sound. She also narrates her own efforts to bring to 
life the music of the French Revolution on the platform Scalar. Geoffroy- 
Schwinden argues that digital explorations of sonic history must do more 
than simply attempt to recreate the sounds of the past; these projects must 
also contextualize the listening perspectives of historical subjects. She 
shows that without understanding what made sound interpretable and 
meaningful to those who produced and heard it, even cutting-edge digital 
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work fails to live up to its promise. Finally, Steph Ceraso considers the multi- 
sensory aspects of sonic experience as a means of rethinking ways to incor- 
porate sound into born-digital scholarship. Beginning with observations 
from her own work, she offers three “sound practices” for helping scholars 
recognize the multifaceted ways in which sound is embodied. She tackles a 
range of issues—from universal design to the tactility ofsound—as a means 
of illustrating a simple but powerful point: the work of digital sound studies 
necessitates creative thinking that pushes against conventional wisdom. 

In an afterword on the futures of digital sound studies, Jonathan Sterne 
responds to the collection in an interview with the editors. This conversation 
—a print remediation of a Skype session that occurred in four different 
places at once—reflects on the shifts in both academic and technological 
culture that brought us to this moment. Sterne discusses the institutional 
infrastructures that will need to change in order to sustain the momentum 
behind work at the juncture of sound studies and digital humanities. He also 
identifies themes humming behind each of the essays in terms of digital 
publication—the platforms that enable it and its relationship to academic 
prestige. This interview, as with the rest of this volume, is a textual artifact 
of digital sonic practice. 

Sterne’s commentary is a fitting place to end as it broadens the conver- 
sation to examine the institutional frameworks that make digital sound 
studies possible. For multimodal scholarship to continue to grow, it must 
be met with significant institutional imagination and collaboration. Schol- 
ars need librarians to aid with accessing and archiving digital materials to 
ensure the long-term preservation and sustainability of emerging forms 
of scholarship. Librarians need the financial and organizational support 
of their universities, and they need an open line of communication with 
academic publishers and for-profit companies about the possibilities and 
limitations of electronic scholarship. Administrators need to be shown, and 
to recognize when shown, the intellectual value of formal experimentation 
and creativity within the broader goals of the humanities. Mentors need to 
encourage junior scholars to take risks while clearly apprising them of what 
they stand to gain, as well as what they may lose, within their particular 
institutional cultures and career trajectories. Educators need training, time, 
and professional development to begin learning how to integrate new tech- 
nologies into the classroom in ways that prepare students to be active partic- 
ipants in twenty-first-century media cultures without losing sight of the core 
values of the humanities. Navigating this dense network of stakeholders is 
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difficult and often risky work, especially for junior scholars who increas- 
ingly find themselves needing to abandon the advice of senior academics 
and forge a path for their own future within a rapidly changing discipline. 

The contributors in this volume are doing just that. By being students 
of their own cultural moment, they harness the transformative potential 
of digital technologies and platforms to amplify underrepresented voices, 
write alternative histories, reimagine the classroom experience, and design 
capacious new modes of scholarship and publishing. That is to say, digital 
sound studies scholars combine the creative use of sonic technologies with 
an informed critical inquiry of them, merging the lessons of digital human- 
ities and the “maker” movement with a thoughtful analysis of digital culture, 
new media, and the sonic possibilities of technologized learning spaces.*? 

Sonic technologies are not unified objects with clear intent or singular 
uses; rather, they are always open to appropriation by users whose actions 
transform the technology itself. Just as the portable reel-to-reel recorder 
catalyzed Eugene Smith’s project, the proliferation of digital technologies 
creates a space for sound scholars to revisit the media and modes that moti- 
vate all stages of the research process. Digital sound scholars are tinkerers, 
inventors, explorers, and collaborators whose experimentations with new 
forms of knowledge production transform diverse fields while transcending 
disciplinary borders. As sound scholars draw on the innovations of digital 
humanities and, in turn, digital humanities becomes amplified, digital 
sound studies enriches the academy as a whole with the power of sonic 
experience. 


NOTES 


1 After discovering Smith’s tapes at the University of Arizona, the Jazz Loft Proj- 
ect’s program director, Sam Stephenson, spearheaded efforts to preserve them 
at Duke University’s Center for Documentary Studies, where we listened to the 
newly digitized reel-to-reel recordings. The digital collection is now housed at 
Duke’s Rubenstein Rare Book and Manuscript Library. For more on the history 
of the collection, see Stephenson, Jazz Loft Project. Some audio recordings can 
be heard on the project’s website, www.jazzloftproject.org (accessed January 
13, 2018). 

2 Since 2003, several key sound studies volumes and collections have been 
published. For a view of the field’s history, see the introduction in Sterne, Sound 
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Studies Reader. Back and Bull’s Auditory Culture Reader takes a cultural studies 
approach, while Pinch and Bijsterveld’s Oxford Handbook of Sound Studies focuses 
more on media and technology. Erlmann’s Hearing Cultures and Smith’s Hearing 
History gather historical work on sound; Novak and Sakakeeny’s Keywords in 
Sound emphasizes ethnography. For perspectives from film studies, a signif- 
icant precursor to the emergence of sound studies, see Beck and Grajeda’s 
Lowering the Boom. The largest and most comprehensive edited volume that 
covers many overlapping subjects—for example, culture, ecology, listening, 
sound and space, and media (television, film, radio)—is the four-volume set 
Sound Studies, also edited by Michael Bull. We are indebted to Brian Kane, on 
the sound studies listserv on Google Groups, who suggested that differentiat- 
ing sound studies anthologies according to their scholarly perspectives would 
be helpful. 

For more about the politics of noise, see Attali, Noise; Goodman, Sonic Warfare; 
Cusick, “An Acoustemology of Detention”; Novak, Japanoise; Cusick, “‘You are 
ina place that is out of the world.” 

Du Bois, Souls of Black Folk. 


5 Onthe cultural legacy of blackface minstrelsy, see Lott, Love and Theft, and 


Lhamon, Raising Cain. On the way dialect affected major spoken-word audio 
collections, see Taylor, “Saving Sound, Sounding Black.” 

Much of this this work examines the intersection of music and culture, albeit 
with a Euro-American bias. See Douglass, Narrative of the Life; Baraka, Blues 
People; Ellison and O’Meally, Living with Music; Davis, Blues Legacies and Black 
Feminism; and Southern, Music of Black Americans. The weight toward North 
America and Europe of this work is indicative of sound studies as a whole. 
Some exceptions, mostly from ethnomusicology, are Feld, Sound and Sentiment; 
Meintjes, Sound of Africa!; Novak, Japanoise; and Ochoa, Aurality. More recently, 
Gustavus Stadler criticized mainstream sound studies scholarship for having 
a significant race problem deriving from its own associations with techno- 
culture; see Stadler, “On Whiteness and Sound Studies.” 


7 Moten, In the Break, 171-232. 
8 Weheliye, Phonographies; Neal, What the Music Said, Soul Babies, and Songs in the 
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Key of Black Life; and Brooks, “Nina Simone’s Triple Play.” 

Meintjes, Sound of Africa! 

Benjamin, “Work of Art in the Age of Mechanical Reproduction”; Adorno, 
Essays on Music; Barthes, Image, Music, Text; Ong, Orality and Literacy; and 
McLuhan, Understanding Media. 

An in-depth exploration of this question can be found in Attali, Noise, and 
Jameson, “Postmodernism and Consumer Society.” See also Deleuze, Difference 
and Repetition, and Chion, Audio-Vision. 

Many transcriptions of these shows can be found in Benjamin and Rosenthal, 
Radio Benjamin. 
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For more on the body as a “sensing agent,” see Helmreich, Sounding the Limits; 
Eidsheim, Sensing Sound; and Erlmann, “But What of the Ethnographic Ear?” 
Sterne, Audible Past, 15-16. 

Thompson, Soundscape of Modernity. 

Gitelman, Scripts, Grooves. 

For more on sonic technologies and the cultural practices of remembering, 
see Bijsterveld, Sound Souvenirs. 

Katz, Capturing Sound, and Paul Miller, Sound Unbound. 

Rodgers, Pink Noises. 

Bull, Sound Moves; Théberge, Any Sound You Can Imagine; and Hagood, “Quiet 
Comfort.” For more on the synthesizer, also see Evens, Sound Ideas. 

For an introduction to such work, see the companion website to the Platform 
Studies series by MIT Press, edited by Ian Bogost and Nick Montfort (accessed 
January 13, 2018, http://platformstudies.com). For a thorough discussion of 
platform theory as it relates to audio technologies and cultures, see Sterne, 
MP3. 

Portable recording devices have played a significant role in ornithology, 

too, enabling scientists and sound archivists, such as those at the Macaulay 
Library, to build large research collections of animal sounds recorded around 
the world by both experts and amateur bird enthusiasts. For more on the 
history of nature recordings, see Bruyninckx, “Sound Sterile,”and Eley, “A 
Birdlike Act.” 

The long history of representing performance traditions of indigenes, under- 
classes, and colonial others emerged from travel writing of the colonial period 
and assumes a distinct character with the rise of blackface minstrelsy in the 
nineteenth century. For more on the recording of African diasporic music in 
musical notation by white authors, see Radano, Lying Up a Nation, 164-229. For 
a digital sound project on one of these early works, see Dubois, Garner, and 
Lingold, Musical Passage. 

Brady, A Spiral Way; Filene, Romancing the Folk; and Karl Miller, Segregating 
Sound. Scholars working on performance traditions from before the dawn of 
sound recording know all too well the constraints that technologies impose 
on research possibilities. Applied ethnomusicologists approach this problem 
by maintaining musical ensembles of traditional music, using performance 
as a form of public archive. See Harrison and Pettan, Applied Ethnomusicology; 
Harrison, “Epistemologies of Applied Ethnomusicology”; and Seeger, “Lost 
Lineages.” 

One example is Feld, Voices of the Rainforest, which is discussed in Feld, “A 
Sweet Lullaby.” Scholars and libraries operating in the public sphere also 
have explored alternative ways of presenting sound. These include R. Murray 
Schafer’s World Soundscape Project (an acoustic ecology project founded 

in the late 1960s) and the more recent activities at the Library of Congress’s 
American Memory Project and the British Library Sound Archives. For more 


INTRODUCTION 


26 


27 


28 


29 
30 


31 


32 
33 
34 


35 


36 
37 


38 


on soundscapes, see Schafer, Tuning of the World and Book of Noise; Truax, World 
Soundscape Project’s Handbook; and Harley, Minevich, and Waterman, Art of 
Immersive Soundscapes. Thanks to Steph Ceraso and Jonathan Sterne for pointing 
us toward these resources. 

For some perspectives regarding these challenges, see Nannyonga-ITamusuza 
and Weintraub, “The Audible Future”; Thram, “Performing the Archive”; and 
Nannyonga-Tamusuza, “Documentation of the Wachsmann Collection.” 

For one investigation into the circulation of digital music in the global South, 
see Steingo, “Sound and Circulation.” 

Wagner, “Bringing Radio Haiti Home.” 

Dinsman and Galloway, “Digital in the Humanities.” 

On quantitative analysis in literary studies, see Moretti, Graphs, Maps, Trees; 
Jockers, Macroanalysis; and Underwood, Why Literary Periods Mattered, and 

his blog, the Stone and the Shell. Several university collectives are currently 
exploring data analysis approaches to the history of literature, including the 
Chicago Text Lab, the Stanford Literary Lab, and the .txtLAB at McGill. For 
interdisciplinary perspectives on distant reading in art and sound studies, 
respectively, see Manovich, “How to Compare One Million Images?,” and 
Clement, “Distant Listening,” as well as Clement’s and Kramer’s essays in 
this volume. 

See, for instance, the work of the #transformDH collective and essays in the 
special issue of differences regarding the “Dark Side of Digital Humanities,” 
especially McPherson, “Designing for Difference,” and Barnett, “Brave Side 
of Digital Humanities.” 

Hartsell-Grundy, Braunstein, and Golomb, Digital Humanities in the Library. 
Klein, Interdisciplining Digital Humanities. 

For example, see Humanities Commons, a web-based networking platform for 
humanities scholars to share their research (accessed January 13, 2018, https:// 
hcommons.org). On digital humanities and peer review, see Fitzpatrick, 
Planned Obsolescence. 

On “tactical” digital humanities, see Kirschenbaum, “Digital Humanities 
As/Is.” For a more general introduction to the field and its debates, see Gold, 
Debates in the Digital Humanities; Berry, Understanding Digital Humanities; Jones, 
Emergence of Digital Humanities; and Svensson and Goldberg, Between Humanities 
and the Digital. 

See Jones, Emergence of Digital Humanities. 

On the history of digital humanities, see Hockey, “ History of Humanities 
Computing.” 

Scalar was created by the Alliance for Networking Visual Culture. Born out of 
a desire to integrate film excerpts more seamlessly into academic writing, the 
platform boasts sophisticated tools for including audio and visual material 
within digital texts. For more information, see their website, http://scalar.usc 
.edu/scalar (accessed January 13, 2018). Several other academic outlets, includ- 
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ing Harlot, have experimented with multimodal scholarship. For example, see 
Ceraso and Stone, “Sonic Rhetorics,” Harlot’s special issue on sound. 

39 Daniel, “Public Secrets.” 

40 Bissell, Freedom’s Ring. 

41 Other recent examples of web projects featuring sound include the London 
Sound Survey; McDonald, Every Noise at Once; and Wall, Virtual Paul’s Cross 
Project. 

42 Fitzpatrick, Planned Obsolescence. 

43 For more about maker culture, see Ratto and Boler, DIY Citizenship, and Ratto, 
“Critical Making.” Also see the accompanying website to the Maker Lab in 
the Humanities (MLab) at the University of Victoria, directed by Jentery Sayers 
(accessed January 13, 2018, http://maker.uvic.ca). 
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ETHNODIGITAL SONICS AND 
THE HISTORICAL IMAGINATION 


RICHARD CULLEN RATH 


I raised my hand, uncertain but determined. The professor, Africanist John 
Thornton, had asked ifanyone knew music. I hesitated. Itwas 1988 and I was 
an adult scholar newly returned to school to pursue my BA. I was uncertain 
whether I was qualified for anything at that point. I had been playing guitar 
for about fifteen years and had a basic understanding of music theory, but 
I was not formally trained. But I thought, “I’m paying my tuition, so...” I 
raised my hand, narrowly beating out another student who later told me she 
hesitated a moment longer than I had. The decision set off a chain of events 
that profoundly affected my trajectory through life and career.* 

The document Thornton gave me was just three or four photocopied 
pages from an old book that he had found on a research trip. The book was 
Hans Sloane’s Voyage to the Islands (1707), a natural history of the islands off 
the west coast of Africa and in the Caribbean, where he focused most of 
his attention on Jamaica.” The pages in question contained a paragraph 
or so of text describing the music and dance taking place at a gathering of 
enslaved Africans on a Jamaican plantation in 1688; an engraving ofa pair of 
stringed instruments and some vines used to clean teeth (and perhaps used 
as strings); and two pages of music described and transcribed by Sloane and 


his musician friend Baptiste that fell under three headings—Angola, Papa, 
and Koromanti. 

Over the course of the next two-going-on-three decades, my interest in 
ethnographic history and the emerging field of sound studies was trans- 
formed by the introduction of digital sound to personal computers. This 
article traces that trajectory and its evolution into what I am calling “eth- 
nodigital sonics,” a term that emerged from a conversation with David 
A. M. Goldberg at the University of Hawai‘i Digital Arts and Humanities 
Initiative over what it was exactly that I did with sound in my research and 
my music as well as in our collaborative work in the initiative. 

“Ethno” refers to the expanded interdisciplinary approaches that ethno- 
historians and ethnomusicologists follow to understand histories and 
musics that are otherwise somewhat incomprehensible through traditional 
single-disciplinary approaches. In this case, I have drawn on linguistics, 
history, anthropology, and musicology to arrive at conclusions not available 
had I taken any single approach in isolation. In contexts other than the one 
used in this chapter, I have employed this “ethno” approach to western 
subjects, so the label describes the approach, not who or what is studied. 
Uncertainty is inherent to this project, given that in this sort of work, the 
sum of the source material still adds up—according to ethnohistorian 
Patricia Galloway—to fragmentary, multiply biased, partially understood 
glimpses.? By making the “ethno” prefix characterize the method rather 
than the object of the study, I hope to bypass the justifiable criticism that 
ethnohistory replicates colonial power relations by offering different types 
of history for colonial actors than are offered for their “others.” I think the 
methodological innovations of the approach are too substantial to warrant 
simply jettisoning the term. It shares this ecumenical approach with cul- 
tural studies and its related fields, so perhaps the prefix will end up being 
irrecoverable. I don’t want to lean too heavily on it when the thing can be 
named in other ways. 

While much ink has been spilled and many bits flipped on the subject of 
method in ethnomusicology, my reading has always been specific and goal- 
oriented: understanding a fragment of music or a snatch of transcription in 
the context of a particular time and place. For the African music in Jamaica 
project, my key sources from ethnomusicology are the foundational work of 
J. H. Kwabena Nketia on the music of Africa and Ken Bilby’s groundbreaking 
work on the music of Maroons in Jamaica.* Although I am aware of the many 
limitations inherent in Western musical transcription, the fact remains that 


30 > RICHARD CULLEN RATH 


in history the fragmented glimpse is often all we get. I cannot, as one ethno- 
musicologist suggested, “go back out into the field” for more. Galloway’s 
warnings to interpret cautiously and suspiciously and the historian’s stance 
of uncertainty are the talismans here, since the questions do not vanish just 
because the methods are inadequate. 

As for the “digital” component of the term, digital audio was slowly 
emerging as an accessible technology in the 1990s. The Musical Instru- 
ment Digital Interface standard (MIDI, introduced in the previous decade) 
became available, for better or worse, on every personal computer with a 
sound card, and it opened up new music-making opportunities along with 
the cheesy game tunes. By the mid-1g90s relatively inexpensive full duplex 
sound cards came to market that brought the recording of CD-quality digital 
audio within reach on personal computers. Macs became the tool of choice 
for musicians, but I could never quite afford one, and pcs—first running 
Windows and then much later Linux—slowly caught up while offering more 
choice, complexity, and ways to go wrong at a cheaper price. Somewhat 
reluctantly, I became caught up in the latter two systems. By the end of the 
decade, audio-file compression made the storage and exchange of music 
feasible for professional sound artists and musicians, with the unintended 
side effect of setting offa revolution of sorts on the consuming end when the 
algorithms broke free.’ In the first decade of the twenty-first century, digital 
synthesis and recording moved seriously into the realm of the personal 
computer with the maturing of consumer-priced digital audio workstations 
(Daws) and the introduction of the vst and au plugin formats that they 
hosted. Professionals also had another, costlier format for the Pro Tools 
DAW called rTAS. In particular, software brought samplers—a high-cost 
piece of hardware in the 1980s and 1990s—within range of any budget. By 
using a sampler, a MIDI pattern editor, and a player called a sequencer, I 
have been able to create and play instruments that would have otherwise 
been impossible on one or the other front. 

I use the term “sonics” to signify the full range of thinking about, listen- 
ing to, feeling, and making sound, including but not constrained to the field 
of sound studies as it emerged in tandem with these digital innovations.‘ 
Historians working within sound studies should note that hearing comes 
into play in two ways. First, hearing has a history: the senses are culturally 
and temporally shaped, and soundscapes of previous times are recoverable. 
One could take the paragraphs above as a personal, somewhat technology- 
driven version of this, as dozens (if not hundreds) of books and articles of 
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wider scope have appeared over the past fifteen or twenty years. Second, we 
can hear history: that is, we can use our ears to understand the past, which 
is the topic of the remainder of this essay. 

Early on in this journey, before sound cards were available and somewhat 
affordable, I puzzled obsessively over the few pages Thornton had given me 
and tried to imagine the sounds. I concocted instruments to test ideas, one 
of which I have kept around to this day. Putting my fingers to homemade or 
adapted sound makers and playing the written music made it clear that cer- 
tain instruments were used on particular parts of the score—a kind of em- 
bodied sonic knowledge that I could not get from the text or images. In the 
Angola piece, the two-stringed banjo-like instrument shown in the engrav- 
ing was played in the bass register because of the fingering it demanded. The 
upper register of that piece was almost certainly played on the eight-stringed 
harp, as it had eight notes in total, and they sounded somehow better when 
they rang out harp-like than when muted by left-hand fingering on a neck. 
(The upper register probably indicated the vocal melody as well.) 

My task in interpreting Sloane’s pages was to exercise what I call the 
historical imagination. I was not trying to reconstruct “authentic” per- 
formances, then or now. I was learning through the combination of touch 
and hearing that is fundamental to much music making. The interesting 
dynamic of the emic (roughly, the insider listening out) and the etic (the 
outsider listening in) came into play, since obviously I was in the latter, 
outsider position (which is of course my emic).’ I was trying to imagine my 
way into the sounds and the history, not only from reading and thinking 
but also through doing and making. My idea was to make sounds using 
the principles that I thought the musicians Sloane and Baptiste used rather 
than create an “accurate” reconstruction, the latter a task too fraught to 
even begin. Some of the principles were aesthetic, others were implied by 
the constraints of Atlantic slavery, and one was discovered in the failings 
of the transcriber but not the transcription. A sampling of the principles 
would include: the choice of one scale over another in music deriving from 
a particular region; improvisation in the making of instruments using the 
materials at hand rather than a free selection; microtonal tunings, syncopa- 
tion and polymeter; and choices about particular timbres.* While I can make 
no claims to have achieved insider understanding, I found much to value and 
learn from trying. 

The music I have made for this project over the years requires as much 
imagination on the listener’s part as on mine. I do not know how the night 
sounds and fire crackling in the background of my most recent digital 
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attempts are made. Ultimately, I ended up getting closest to the sound 
of a live setting from an utterly artificial set of processes—sampling and 
sequencing—but that waited until the hardware and software had come 
within my reach. The setting on the Jamaican plantation in 1688 was ob- 
viously different from the conditions of reception, whether reading or lis- 
tening, and layers of meaning exist in the distinction between audience and 
performer that would have been foreign to the Africans playing the music, 
although such distinctions are intrinsic to current understandings. 

The stakes in these historical imaginings are high. For example, I am 
unwilling to take on the voice of enslaved Africans myself, and I am equally 
queasy about making it a singalong with audiences of mostly white folk 
providing the handclaps and the “Alla, Alla” refrain of the Angola piece. 
In light of the long history of minstrelsy (a tradition that perhaps lingers in 
the form of white suburban consumption of hip-hop), such a performance 
would adumbrate the power relations of both historical and present-day race 
relations and elide cultural appropriation into feel-good, irresponsible pop 
history. I think we can learn as much from what is left undone, unsung, and 
unplayed as we can from what is not, and I will not give voice to singing that 
linguistic and musical evidence conveys as having been hauntingly spectral, 
the voices of a community carried far from home to a strange and brutal 
land. 

I was game to try the music, though, encouraged in that direction by the 
way musicians constantly borrow across cultures without the same sort of 
constraints that arise with vocal performance. I also could learn from what 
was absent as well as from what was there—drumming is made mostly of 
patterned absences, after all. The drums were missing altogether in the 
Sloane music. He reported that the musicians’ use of drums “in their Wars 
at home in Africa” made them “too much inciting . . . to Rebellion, and so 
they were prohibited by the Customs of the Island.”° In West African music, 
particularly that from the region that Koromanti designates, drums served 
as an immanent display of state power. They meant serious business in the 
Americas as well. Slave revolts, including a successful one in Jamaica a de- 
cade or so before Sloane’s visit, were often organized around a drumbeat, 
sometimes a particular one recognized by the rebels as both a signal anda 
sign under which they fought for freedom.” Their absence is thus as mean- 
ingful and significant as the presence of other instruments. 

Iused a cheap nylon-string guitar to stand in for the two-stringed banjo- 
like instrument. I played the two top strings of it in a dropped tuning and 
wove a thin strip of torn paper between the strings to create a dull, buzzing 
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sound, a trick I learned as a teenager when I wanted a fuzzy electric guitar 
effect and only had an acoustic. I wanted the buzzing for three reasons. 
First, the image showed an instrument with no bridge, which would make it 
sound muted and buzzy. Second, the aesthetics of much West African music 
value this buzzing, a preference that not coincidentally can be found in the 
fuzzy, distorted guitars in modern music from early electric blues onward. 
Third, the instrument in the background in the images of African music and 
Jamaica, used for comparison, is either a South Asian tanpura (which also 
has a flat bridge that imparts a characteristic buzzy and harmonically rich 
sound called jivari) or, alternatively, itis a Native American instrument made 
by forced-labor immigrants sold from the Carolinas into slavery in Jamaica 
ata rate of two enslaved indigenous people for one enslaved African." Either 
is possible, since Sloane collected instruments from India and was an ardent 
comparativist in his study of natural history with proclivities toward the 
“cabinet of curiosities.”*? He just labeled the comparative instrument in the 
engraving as “Indian,” so it is impossible to determine with certainty what 
he meant. I opted to emulate the South Asian instrument because of the 
buzzing. 

The eight-stringed harp, which played the eight-note upper register in 
the Angola piece, was another adaptation of what I had at hand. This time I 
took two acoustic guitars (one nylon string and one steel string, since that 
is what I had), wove in the paper strips, tuned eight of the open strings to 
the notes of the upper register, set the guitars next to each other, and picked 
out the melody. This captured the open, sustained sound of a harp as well 
as the characteristic buzzing. Again, as a reconstruction I have no idea of 
how it fared—I like to think reasonably well—but as a tool for figuring out 
which instrument played which part, it was a useful exercise in historical 
imagination that helped me understand the music and musicians. 

The Papa piece was too short to make much of, and the three pieces 
subsumed under the Koromanti title did not fall neatly into instrumental 
patterns when played on my emulations of the two-stringed banjo and the 
eight-stringed harp. For the Koromanti pieces I returned to Sloane’s textual 
description ofa musician playing on “the mouth of an empty Gourd or Jar.” * 
Since the other instruments did not seem to fit these musical passages as 
well as in the Angola piece, I surmised, with no great certainty, that Sloane 
only saw the mouth of the gourd and the musician’s hands and had missed 
that it held a sansa (thumb piano) that used the empty bowl as a resonator. 
This is speculation, and it is possible to play the Koromanti pieces on a mod- 
ern banjo, but they become much more difficult on the two-stringed banjo 
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because of the long ascending and descending passages, which are impossi- 
ble on the eight-stringed harp.“ The sansa’s keys, which sound consecutive 
notes in a scale on alternating sides, facilitate exactly such ascending and 
descending runs. 

I thought about the constraints the musicians were under. They had the 
knowledge and principles of the sansa but an impoverished access to ma- 
terials and tools. What could they make with what was at hand? Probably 
nothing with the metal keys of modern African sansas—the ones usually 
known as mbiras—as metal would be valuable and scarce. Plus, the instru- 
ment would need to make a sound too distinctive to be mistaken for percus- 
sion. I guessed that they used thin strips of wood or bamboo as the keys to 
a sansa-like instrument. 

I wondered how to emulate the sound. At the time, I was working at a 
shoe store to pay for tuition, rent, and food. New shoes often came stuffed 
with paper in the toe and a thin, eight- or nine-inch-long strip of flexible but 
sturdy bamboo that held the paper in place. I began saving them. I checked 
their sound by holding one end to the edge of a desk and plucking the other 
end. Lengthening or shortening the overhanging distance changed the pitch 
recognizably, butit still had a satisfyingly woody, buzzing, percussive thunk. 
I collected eighteen of the best-sounding ones and with a strip of wood trim 
pinned them to the bottom of an old dresser drawer that a previous tenant 
had left in the basement of my apartment. The drawer had a nice resonant 
sound. A slim-diameter piece of dowel jammed under the bamboo strips on 
one side of the wood trim made a bridge. I suppose if I had been attempting 
a reconstruction rather than practicing historical imagination, I would have 
waited for fall and gotten a big round gourd rather than a dresser drawer. 

Sliding the bamboo strips forward and backward, I could adjust the notes 
of my sansa, which I dubbed the “bamboomba,” to any scale I desired, in- 
cluding microtonal ones. This turned out to be quite important, because one 
of the three Koromanti pieces had an extra note in it that threw everything 
off kilter (fig 1.1). I guessed from playing around with the sansa that two of 
the notes in the Koromanti transcription actually indicated a single note 
that was a microtonal interval to its neighbors. Baptiste, the transcriber, 
could not parse the note through the filter of European notation, so he wrote 
the “off” note as two notes, flickering between them in his transcription. 
Changing the note to a microtone yields what is now called a “blue note,” 
one that would fall between the notes of piano keys and a sound familiar to 
anyone who has heard blues or rock guitar. 

I recorded my guitar and bamboomba experiments on a bottom-of-the- 
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FIGURE 1.1 The bamboomba. 


PHOTO BY THE AUTHOR. 


line four-track cassette recorder but was never particularly happy with the 
outcome: although the treated guitars taught me a lot, they sounded more 
like treated guitars than the instruments I imagined. In contrast, the bam- 
boomba sounded just like I imagined it. Unfortunately, I could not put in 
the time to learn the three Koromanti pieces in any but the most halting 
manner. 

I finished an article on African music in Jamaica in 1993 and set the proj- 
ect aside during my first few years of graduate school. By 1995 I had saved 
up for a real treat—an early “full duplex” sound card that allowed the si- 
multaneous recording and playback required for multitrack recording. This 
launched the digital part of my journey in earnest. I could record up to four 
tracks, though only one at a time. My first project was to create a multitrack 
recording of the two-register Angola piece, using a guitar with two detuned 
strings for the lower register and the same guitar played on all strings for 
the upper. A third track was devoted to a simple percussion line. 

The soundcard also had a nice on-board MIDI synthesizer so that I could 
write MIDI sequences and play them back. I could load my own sounds 
into the card too, but it took forever and was not worth the trouble. It did 
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introduce me to sampling, though, which later would play a bigger role in 
my research when the technology became software based and fell within my 
reach in both price and ease of use. The General MIDI instrument specifica- 
tion provides for a sansa as one of its instruments, so even though it was a 
metal-keyed version that could not produce microtones, I programmed the 
Koromanti pieces in their full 1995 cheesy MIDI glory.* I shared my record- 
ings with a few people who used them for teaching or were just interested, 
and they achieved a little samizdat-style circulation. They became part ofacD 
hypertext project called Migration in Modern World History.*° When the Mp3 
format began to take hold, I posted them, along with many other pieces I 
had recorded, on my website and began using them in my teaching as soon 
as sound was incorporated into classroom computer setups.” 

Sonic presentation clarifies sonic ideas. Learners do not easily grasp con- 
cepts like microtones and polyrhythm through language. They readily hear 
them though. Polyrhythm, for example, is much easier to teach through a 
simple clapping exercise in which one side of the room claps every third beat 
and the other side claps every fourth. Generally, some comedy ensues the 
first few tries, but then the audience hears it, and once that happens, they 
know it. And everyone has heard microtones in the bent strings of a lead 
guitar, at which point they cease to be something esoteric and become “oh 
that, of course.” Having classroom computers with sound cards has had a 
transformative effect (though perhaps not for the clapping) on being able to 
teach with sound. 

This type of learning pays off by making more accessible the experiences 
of people who are not well represented in traditional documentary sources. 
Sound delivers affect and the ability to strike the nonrepresentational aspects 
of being. When working to document the lives of enslaved Africans, I seek to 
avoid one of the oldest and most patronizing ways of telling the histories of 
people underrepresented or misrepresented in the documentary evidence: 
framing them as emotional and implicitly irrational beings, perhaps lacking 
in powers of representation, and presenting them as a sort of foil to logical, 
rational, and often paternalistic textual representations. Perhaps the most 
thoroughly articulated versions of this type of patronization are the theories 
of orality and oral culture that posit a great divide between literate thinking 
and that of everyone else. Recently, though, affect studies—which attend to 
nonrepresentational forces, the embodied relational abilities to affect and 
be affected—have come to the fore in new ways, so maybe there is yet a role 
for affective histories that are not reducible to hoary generalizations. The 
practical part of sound’s presence is that students and audiences connect 
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to it in a different, perhaps more direct, way than to texts, a connection 
grounded in the body and experience as well as (and not in contrast to) the 
representational and the textual. 

An oft-used trope in literary studies and historical work argues that since 
the source documents are biased to the core, we can tell nothing of the sub- 
jects they purport to describe, having only the psyche and fantasies of the 
white, usually male authors of the documents in question. Gayatri Spivak 
famously answered the question, “Can the subaltern speak?” (in reference 
to the practice of widow burning in colonial India) with a provisional, “Not 
really.” She argues that despite the damages of colonial oppression, or in 
fact because of them, all we can really know about the widows is what the 
British authors of the texts thought they were experiencing—but nothing of 
the women’s experience itself.” 

In the Sloane materials, however, we have an interesting incursion. 
Sound is promiscuous, infiltrating and mixing freely without any attention 
to the intentions or desires of the listeners or even the producers. Sloane 
and Baptiste recorded the microtones, the polyrhythms, and the buzzing 
aesthetic without having a framework for doing so—the concepts were 
simply not present in Western music of their time. It was as if the Brahmin 
widows had been able to write through the mediumship of the British au- 
thors, who transcribed in a language they did not know and were not aware 
of writing. This hidden transcript in the Sloane materials only emerges 
when the sounds are rendered audible. While sounding them out does not 
offer unmediated access to the subaltern past (any more than do the texts for 
power holders), it does provide glimpses into the processes of cultural for- 
mation under the duress of slavery that move beyond models of resistance 
and accommodation, which are by definition always described in the terms 
of the master class.”° 

The problems of bias extend beyond the text into the digital domain 
as well. Ethnodigital musicians battle an implicit Eurocentrism in music 
software and hardware. It can be overcome, usually via a workaround or a 
deviation from an implied norm derived from Western classical music. For 
example, rendering polyrhythms using sequencers (composing software 
that is something like piano rolls) is easy in some applications but harder 
in others, depending on whether the bars of the sequencer can be set to 
different lengths. Many drum sequencers favor powers of two, having fixed 
lengths of eight or sixteen beats, neither of which is divisible by three, of 
course. For the simplest polyrhythmic work of three against four, the length 
of the sequence needs to be twelve ora multiple thereof, but this is often not 
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an option. More complicated polyrhythms, which abound in non-Western 
music, are even less accessible. The bias, though not the rule, is toward a 
steady 4/4 meter, and the ethnodigital sonician has to improvise and make 
do in many cases.” 

Creating microtones in MIDI presents different challenges. Part of the 
difficulty stems from the fact that MIDI is a Eurocentric language, the 
“nouns” of which are equal-temperament notes that must be bent and 
shaped by the “adjectives,” in this case pitch-bending messages that modify 
the notes on an individual basis. Equal temperament is the norm, and mi- 
crotones are temporary deviations. This can be countered in some software 
through tuning files that change the values of the “nouns” at the outset, 
mostly by adjusting the pitch-bending deviations behind the scenes. Until 
recently, though, the software has been fiddly and difficult or prohibitively 
expensive, and writing the tuning files remains a challenging enterprise. My 
goal of rendering MIDI files that sound more accurate, both in timbre and 
in tuning, took a long time and many false starts to realize. 

Ethnomusicologists have dealt with these constraints in Western music 
notation for years, but they take on a different valence when they are built in 
to the composition process rather than the analysis of the music. It would 
be interesting to see what sort of musical language MIDI would have been 
ifit had been designed by a consortium of musicians from around the world 
rather than a panel of music industry representatives. A newer protocol has 
emerged in recent years; called open sound control (Osc), it addresses some 
of the issues raised here from the ground up, but its adoption both in soft- 
ware and by musicians has been slow. 

Despite this slow and uneven development, word about the musical 
versions I made of the Sloane transcriptions did circulate. Someone from 
a public television documentary team approached me in 2006 about using 
the recordings for a special on Jamestown and the first Africans who were 
sold there in 1619. I shared my (nonmicrotonal) MIDI files of Koromanti and 
the treated acoustic guitar rendition of the Angola piece. After some back 
and forth, the team decided not to use the music because “it was too upbeat 
for the portion that we were applying it to! Beautiful music—but we were 
looking for something a little more ‘down.’” I was intrigued (and of course 
alittle disappointed) by this rejection. Ican see why a documentary that has 
a limited time to express a complex idea to people unfamiliar with it would 
not want any gray areas in the interpretation, especially when they could be 
construed as making slavery seem happy or as portraying the people within 
it as carefree, with no other thought in the world beyond their day off and 
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some music and dancing. Such positions arose from the work of Ulrich 
Bonnell Phillips and other southern historians from the early twentieth 
century, and the “carefree slave” trope haunted popular culture well beyond 
the 1960s.” The documentarian’s rejection of the music was a prophylactic 
reaction to this older, decidedly racist strand of American historiography, 
the critique of which has, over the course of eight or so decades, seeped into 
the public consciousness at least as far as the television documentary. 

But the sound and affect of the Angola and Koromanti music also raise 
an interesting question: Is there such a thing as absolute slavery? Can the 
soul of another human being be controlled so absolutely that we can reduce 
that person’s emotional range to nothing but sad songs and sorrow? I like to 
think of music as a release, an autonomous zone apart from the usual tropes 
of resistance and accommodation. I could sound the Sloane excerpts not 
necessarily in reference to slavery, but not necessarily discounting it either, 
attributing more to the human than just “the slave.” The musical pieces I 
was studying made a space where enslaved Africans could be sometimes 
fierce, sometimes joyous, sometimes lustful, sometimes sorrowful, and 
more fully human than was possible within the constraints slave masters 
both imagined and tried to realize. Here were several competing historical 
imaginaries: those of the Africans, the masters, Sloane, the television doc- 
umentary, Ulrich Bonnell Phillips, the audience, mine, and yours, as well as 
those of other audiences with whom I have shared this idea. 

I think that the idea of total slavery with absolute slaves was ultimately 
the fantasy of the masters rather than a description of lived experience. 
The enslaved never became the comprehending-but-not-thinking working 
objects that their masters wished them to be, as brutal as the institution 
was. Nor were they all and only “down.” I would posit that the full range of 
emotions that can be culled from these pieces—everything from the ghostly 
sorrow of lost and wandering human communities to “too upbeat”—is 
evidence of such. The affective power of sound to change the ways people 
experience things even before and long after they have thought about them 
means that it matters. 

This question of the destructive effects of slavery on African culture 
brings us back to an old but fascinating debate initiated in 1939 between 
the African American sociologist E. Franklin Frazier, who made a case for 
the utter destructiveness of slavery on a usable African past, and the white 
anthropologist Melville Herskovits, who argued the contrary position by 
cataloging hundreds if not thousands of Africanisms in American culture. 
Frazier got the better of the argument well into the 1960s. It became import- 
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ant enough that in 1965 Daniel Patrick Moynihan, an adviser to President 
Johnson at the time, framed it as his infamous “culture of poverty” argu- 
ment, which became the basis of welfare policy for the next three decades. 
The Black Power movement shifted the momentum to Herskovits’s side, 
and responding to this politicization, anthropologists Sidney Mintz and 
Richard Price proposed a mediating approach using creolization as their 
theoretical frame. Unfortunately, this has more often than not meant a re- 
turn to the Frazierian claim touting the destructive and innovative effects of 
slavery at the expense of African culture, so much so that some historians 
have mistakenly situated creolization in opposition to cultural continuities 
in the Americas, treating them as competing and antagonistic models.” 

What the music points toward is a more nuanced understanding of 
how all these tendencies—creation, destruction, and persistence—were 
and are integral to each other for anyone who thinks deeply about today’s 
multi-billion-dollar popular music industry. All are necessary ingredients 
to understanding the complexities of African—and European—life in 
the Americas. This understanding of creolization shows us how cultural 
continuities, destruction, and innovation were twisted together in a highly 
creative generative process that continues to have effects to this day. 

But maybe it was the microtones. I found that time and new, less 
expensive sequencing and sampling software made it possible to play the 
missing microtones, even when I was not sufficiently adept to play the music 
on the sansa I had made. I tuned the bamboomba to Western scales and 
recorded for each of the keys a soft, medium, and loud pluck. I imported 
these into a sampler that could trigger the appropriate sample when notes 
were played, and I massaged the notes in the sampler to play the microtonal 
scales I needed (fig. 1.2). I am no better on keyboards than I am on sansa, 
so I tried triggering the MIDI notes through a guitar with a MIDI output on 
it. This was moderately successful, and I went on a mini tour of two confer- 
ence performances in 2010 and 2012. The setup was awkward, bulky, and 
skittishly complex to prepare fora performance. After a particularly difficult 
second outing, I have put the live version on hiatus (unless you want to book 
me!), but it is quite fun to play a guitar and have a completely different in- 
strument emerge from the speakers. 

A better solution was to sequence the MIDI—I had already done this—and 
then use the tweaked samples to capture the microtones. Where Baptiste’s 
flickering notes occurred, I resolved them into a single microtonal note. 
This meant I could digitally separate what was played from the notation, 
which better resembles what I imagine the process to have been. After years 
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FIGURE 1.2 Recording of the bamboomba imported into a sampler. 


of pondering the problem, I have a solution and a version—minus vocals and 
plus some night sounds and percussion—that approximates what I imagine 
the instruments and dancers sounded like on that night in Jamaica in 1688. 

Using digital tools and a bit of historical imagination, both mine and my 
listeners’, I have found inroads into understanding a bit more about the lives 
of Africans in seventeenth-century Jamaica as well as the processes, con- 
straints, feelings, and creativity that went into building a distinctively new 
culture in the Americas under unimaginably harsh conditions. Although the 
trail of documentary evidence on this subject gives out if we limit ourselves 
to reading the texts, by setting aside the academic perquisite of ex cathedra 
certainty, whole new avenues of understanding open up when we listen. I 
have tracked my path through this process as constituting “ethnodigital 
sonics,” and I would offer that path as one way of undertaking the practice 
of it. I hope others will find this a useful road map for the practice and its 
possibilities. 
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NOTES 


1 


The most recent versions of my performances of the musical pieces referenced 
in this chapter are available at “Ethnodigital Sonics Meets Maker Culture 

in Seventeenth-Century Jamaica” (accessed January 16, 2018, http://way.net/ 
AfMusicJam). 

Sloane, Voyage to the Islands, vol. 1. As I was revising this essay, an excellent new 
website that highlights the section of Sloane under consideration in this chap- 
ter came online: see Dubois, Garner, and Lingold, Musical Passage: A Voyage 
to 1688 Jamaica. 

Much along the same lines found in Galloway, Practicing Ethnohistory, 27, and 
throughout. 

Nketia, Music of Africa and African Music in Ghana; and Bilby, “Kromanti Dance,” 
“Caribbean as a Musical Region,” and “How the ‘Older Heads’ Talk.” 

Sterne, MP3. 


6 The best single-volume introduction is Sterne, Sound Studies Reader. 


7 For the dynamic approach to the terms I have taken, see Hymes, “Emics, Etics, 


13 
14 


15 


and Openness,” along with the other essays in that volume. 

For the details, see Rath, “African Music in Seventeenth-Century Jamaica,” and 
How Early America Sounded, 8—9, 68—93. 

Sloane, Voyage to the Islands, 1:xlviii—xlix, lii. 

Rath, “Drums and Power.” 

Gallay, Indian Slave Trade. 

On cabinets of curiosities, see Kupperman, Indians and English, 21-22, 3491.13; 
for the specific context of Sloane’s collection (which became the basis of the 
British Museum), see Delbourgo, “‘Exceeding the Age in Every Thing.” 
Sloane, Voyage to the Islands, 1:xlix. 

For a video of the Koromanti piece played on banjo, see Burton, “Older than 
Minstrel.” David K. Garner plays several of the Sloane pieces on a fretless 
banjo on the Musical Passage website cited in note 2. 

MIDI itself has no sounds, only instructions to tell a synthesizer to sound 

a certain note at a certain pitch and velocity (relative volume) for a certain 
time on a certain channel from a certain sound bank. The sound banks of the 
synthesizer can contain any arbitrary MIDI-capable synthesizer, including 
the ones built in to Microsoft and Apple operating systems. “General” MIDI 
is a specification implemented to bring some predictability to the sounds a 
MIDI file produces and includes a numbered set of 128 target instruments, of 
which number 109 in the “Ethnic” group is the kalimba, a metal-keyed sansa. 
The actual sound produced is still left up to the synthesizer, which used to be 
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23 


a separate board on early soundcards. In the 2010s, as computers have grown 
more powerful, the synthesizer on a home-use personal computer is generally 
executed in software. The sound itself thus was built into my sound card in 
1996, but it was specified by General MIDI program 106, hence the awkward 
wording of the passage. For details on General MIDI, see MIDI Manufacturers 
Association, “About General MIDI.” 

Manning etal., Migration in Modern World History. 

Rath, “African Music in Seventeenth-Century Jamaica.” 

Gregg and Seigworth, Affect Theory Reader, and Goodman, Sonic Warfare. 
Spivak, “Can the Subaltern Speak?” For an important rejoinder, see Mani, 
Contentious Traditions. 

For hidden transcripts, see Scott, Domination and the Arts of Resistance. For 
alternatives to the resistance models and the ways the cultural formations 
took shape in North America and the Caribbean, see Rath, “African Music 

in Seventeenth-Century Jamaica,” “Echo and Narcissus,” and “Drums and 
Power.” For hegemony, see Gramsci, Selections from the Prison Notebooks, ably 
critiqued in Lears, “Concept of Cultural Hegemony.” A whole body of slavery 
studies from the 1950s to the present is based on the notions of resistance and 
accommodation but is beyond the scope of this chapter to review. 

An internet search for “Euclidean Rhythms,” itself a somewhat Eurocentric 
framing, will return a host of links to wonderful homemade software based 
on the research of Godfried Toussaint, but the inventions take the form of 
optional extensions to the major music creation platforms rather than being 
integral to any of them. See Toussaint, “Euclidean Algorithm.” One iOS app, 
Patterning, from Olympia Noise Company, does manage to incorporate 
polyrhythmic possibilities by using a circle rather than a piano-roll model, 
with each of the rings that constitute the sequencer divisible into any number 
of steps. 

Phillips, Life and Labor. 

The Herskovits-Frazier debate is attended to in depth in Rath, “Drums and 
Power.” For the mistaken notion that creolization is opposite to African conti- 
nuities, see Lovejoy, “African Diaspora.” 
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PERFORMING ZORA 


Critical Ethnography, Digital Sound, 
and Not Forgetting 


MYRON M. BEASLEY 


It is evident that the sound-arts were the first inventions and that music 
and literature grew from the same root. 


— ZORA NEALE HURSTON, “Folklore and Music” 


Research is formalized curiosity. It is poking and prying with a purpose. 


— ZORA NEALE HURSTON, Dust Tracks on a Road 


| just wanted people to know what real Negro music sounded like. 
... Was the real voice of my people never to be heard? 


— ZORA NEALE HURSTON, “Folklore” 


TRACK 1: (Re)mixing Zora at the Rooster 


The Red Rooster is more than just a restaurant on Lenox Avenue in the heart of Harlem. 
It could be mistaken for a library, an archive, a museum, or even a plush humanities 
center on a college campus. The primary wall is filled with books, magazines, albums, 
and other ephemera of black cultural production with the opposing walls well curated 
with visual art by noted African American artists. The bar sits in the center. On one 
particular Thursday evening the Dy huddles in the corner mixing the tunes with a turn- 


table connected to his Mac Powerbook. “Birds flyin’ high, you know how I feel,” the first 
line from Nina Simone’s hit “Feeling Good” (1965), permeates the restaurant. Simone’s 
strong, robust voice is reframed with a techno beat yet sustained with the slower moves 
of the most popular version. As the techno line crescendos into a clash, waves of vocal 
tracks disrupt the seemingly haphazard sounds. First the voice of Langston Hughes 
reading “I have the weary blues,” followed by the stern, firm voice of Maya Angelou 
vocalizing lines from I Know Why the Caged Bird Sings. Followed by (probably 
the least familiar to casual listeners) a track that jarred most—the voice of Zora Neale 
Hurston crooning “Halimuhfack.”? Hurston’s track halted the flow. The gritty, dusty, 
scratchy quality transported the listener to another time, to another place. The pastiche 
of sounds curated by the Dj was a “remix” for sure. The audio palimpsest—layering 
a mix-match of music weaving literature, ethnography, biography, and history—the 
techno-digital moves of the DJ announced the confluence of digital sound and human- 
istic inquiry. 

The performance at the Red Rooster reflects what cultural critics Mar- 
tha Buskirk, Amelia Jones, and Caroline Jones proclaim in their review of 
the cultural productions of 2013: that this moment of humanistic inquiry 
is dominated with the prefix “re-.”? In this moment in the U.S. academy, 
the demise of the humanities is announced often in the popular presses, 
with some faculty who occupy such locations bewildered and clamoring for 
survival. Funding is shrinking and some departments are being eliminated. 
The justification for such measures is wrapped in the discourse of precarity. 
While many scholars feel the need to “resuscitate” the humanities, others 
take solace in “rethinking” and advancing and enhancing humanistic in- 
quiry by reimagining with technology. The DJ spinning at the Red Rooster 
was a performance of reimagining humanistic inquiry and thus creating 
new forms of text—a haunted text evoking an infectious performance 
through the weaving of sound, technology, and digital elements.* While 
Buskirk and her colleagues “re-create, reanimate, recast, recollect, recon- 
stitute, reconstruct, reenact” in their review, rememory or recalling does not 
appear.’ As this chapter considers the sonic work of Zora Neale Hurston in 
light of the contemporary conversations regarding sound studies and digital 
humanities, it recalls the significance of Hurston in the changing domain 
of ethnography, thus situating performance as both a method of inquiry 
and an embodied phenomenon, the move with which performance spawns 
new forms of texts and modes of performance. Yet discussing black cultural 
production within the panoply of technology warrants a contemplation of 
capitalism, cultural meshing, and cooptation. 

Alexander Weheliye reminds us, as did Henry Louis Gates (and others) 
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before him, of the rambunctious nature of African American cultural 
production. The sense making of daily life within communities of the 
African diaspora manifests itself in a motley assemblage of performative 
acts. The means of documenting, representing, and preserving life were 
rarely confined to the printed text. Rather, the visceral experiences were 
performed—through orality. (I place material culture as performance.) What 
Gates locates as the “trope of the talking book,” he adroitly explicates as the 
dialectical strains between the written and oral text. The violent history of 
literacy for blacks in the Americas is an exclusionary practice and presents a 
unique dynamic of engaging with the domain of black humanistic inquiry. 
Gates recapitulates the polyvocality and the orality that surround “texts”— 
paraperformance that lurks outside and around the written and oral “texts” 
that signal “always more than whatit appears to be,” or more familiar “signi- 
fying.” Such playing with texts speaks to the fluid, infectious, and contested 
nature of black cultural production. Yet Weheliye, moving from Gates and 
others, contemplates the role of digital technology in “recorded” production 
and situates the deployment of black culture with the interplay between con- 
sumption (capitalism) and subject/identity discursive formations. At stake 
is erasure. Playing with the concept of “sonic Afro-modernity,” Weheliye 
considers the rise of the phonograph and the reproduction and distribution 
of African American sound. As black sound attains “market value,” the 
propensity for fetishization—a subject without citation, a subject without 
identity—becomes more acute. The commodification (read: capital) of black 
diasporic culture without critical interventions encourages the separation 
of the I am I be—subjectivity and identity—which Weheliye claims is the 
pervasive philosophy that has “run amok” in the Anglo-American human- 
ities.* To insist on the I am (subjectivity) I be (identity) as a unit, a both/and, 
a synergetic dialectic, allows for and opens up a space to foreground the 
sonic discourse in black cultural studies and provides more diverse ways to 
think more broadly about black cultural production. The audio palimpsest 
performed by the py at the Red Rooster is a fitting example of ways in which 
sonic imprints insert the past in present, lived realities—always recalling, 
never allowing a forgetting, but producing new forms of representations 
and suggesting new ways of engagement. 

The tracks of Hurston’s voice in the stream of a techno dance mix at the 
bar in Harlem were a “hailing” to be sure, but they were also a haunting. The 
domain of performance rests in its ephemeral nature. Once a performance 
happens it disappears, according to Peggy Phalen, suggesting ontology of 
disappearance.” Derrida proposes (and I agree) a move beyond ontology 
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toward a hauntology, as he advocates the nature of truth as derived from 
engaging the thing and not merely the thing itself.*? Hauntology therefore 
highlights the persistent, contested, and infectious nature of perfor- 
mance." Barbara Browning likens the generative nature of performance 
to infectious rhythms. The term vibes with Paul Miller, who like Browning 
uses epidemiology as metaphor to describe the ways in which digital tech- 
nology has enhanced and, I dare say, reframed the work of a Dy (whom he 
labels a rhythm scientist).*? For Miller, Dy mixes produce vectors that are 
capable of infecting agents that have the potential of becoming infectious." 
Performance theorists are not preoccupied with the performative act itself 
but rather the generative nature that comes from engaging with the per- 
formance (performances never end), its mixings and ability to spin further 
questions, deliberations, and theoretical discourses. Like the DJ spinning 
and weaving different strands of cultural elements, digitized and meshed 
with technology, performance in its infectious nature flows and morphs 
into new forms of performances, new ways of participation. 

As the consummate performance ethnographer, Zora Neale Hurston 
embraced the convergence of performance as a method of inquiry, exhibited 
the domain of performance as an embodied phenomenon, and exacerbated 
the critical space in between. A haunted space, lacuna of possibilities, also 
allows for the explorations of Hurston’s work in the frame of the synchro- 
nous I am I be and other multiple interactions and perspectives, and creative, 
imaginative, and critical inquires. 

The performance at the Red Rooster—the DJ moving, weaving Hurston’s 
voice with manipulated recycled contemporary tones as the audience en- 
gaged in the happenings of the moment—was a creative and imaginative 
opening produced by the collaboration between sound and technology. The 
digitized voices of literary figures and the use of technology to mix and 
infuse diverse sounds make it possible for me to consider Hurston’s work. 
Zora Neale Hurston was at this moment at the Red Rooster, on Lenox Ave- 
nue in Harlem, a site Hurston inhabited years before. The digitized sounds 
of her voice haunt us, creating more performative spaces of possibility, the 
chance to reimagine her and her work in different ways to different audi- 
ences, yet they recall her contributions and resignify her influence as to not 
forget her! 
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TRACK 2: Meeting Baldwin, Meeting Zora 


On December 1, 1987, the voice on the radio in my small flat in Paris an- 
nounced the death of James Baldwin: “James Baldwin, the black American 
writer . . . the author of Go Tell It on the Mountain.” The announcement would 
continue throughout the day, as Baldwin was most revered in France. I had 
not known of James Baldwin, nor had I read any of his work. I rushed to the 
used bookstore down the street to search for work by this famous black 
American whom I did not know. I found a copy of Go Tell It on the Mountain ona 
bookshelf, but on the floor, just underneath the lower overflowing shelf, was 
a tattered copy of Hurston’s Their Eyes Were Watching God. I purchased both. 

I struggled at first while I silently read through the brown and occasion- 
ally soiled pages that disguised the breadth of knowledge that would come 
to have a significant influence on my life. I began to read her words aloud— 
carefully moving my tongue and lips to imitate the unfamiliar diction of the 
written text. The tongue slithered about, arching to touch the awkwardly 
placed plosive, but eased into the slowly paced diphthong. An enlivened 
spoken word captured me the reader, coerced me to listen to the nuanced 
sonic movement of her text. 

At the death of Baldwin, I met Zora. 


TRACK 3: Boas, Boas, Boas 


When anthropologist Franz Boas asked his then-student Zora Neale Hur- 
ston to travel to Florida and record the folklore of her childhood town of 
Eatonville (1935, 1938), Hurston returned to Boas with audio of herself sing- 
ing the folkloric songs of her and the city’s past. This moment with Boas is 
significant. The performance by Hurston signaled an epistemological shift 
in the social sciences and humanistic inquiries surrounding how to “read,” 
“write,” and “represent” culture. 

When I first encountered Zora Neale Hurston in 1987, I was a second-year 
student in college; my majors were oral interpretation/rhetoric and anthro- 
pology. The field of rhetoric in the discipline of communication studies then 
privileged the concept of “speech” or oratory and oral interpretation. Oral 
interpretation is the art of “suggestion” (as opposed to action) with the aim 
of, according to Charlotte Lee and Timothy Gura, communicating a text 
in its “intellectual, emotional, and aesthetic entirety” in words.** Students 
mastered the International Phonetic Alphabet, learned how to dissect the 
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paralinguistic qualities of words, and scrutinized texts to enliven the writ- 
ten work for the ears. “Great literature was not only written to be read, it was 
also written to be heard,” was acommon refrain. Pedagogy and scholarship 
were preoccupied with the persuasive use of and performance of written 
texts.*° Simply, oral interpretation was about the criticism of and the (re)per- 
formance (reading aloud) of written text (including poetry, speeches, and 
other forms of printed texts). As traditional anthropologists continued to 
stake claim to the word “culture” despite the emergence of feminist theory 
and ethnic studies in the academy, ethnographers advocated for greater 
inclusion of physical participation and self-reflection to develop theory and 
analysis. At the point of my matriculation to college, a theoretical shift was 
occurring. Modernism was being condemned and, as postmodernism was 
just getting its footing and stride, critical theory/cultural studies invaded 
and challenged contemporary thought in multiple ways, including oral 
interpretation/rhetoric and anthropology. 

The primacy of the written text was debated, and the mere definition of 
“text” was challenged. Barthes proclaimed that the death of the author en- 
dorsed the power of the text itself, while Dwight Conquergood encouraged 
those in the speech/oral interpretation/rhetoric arenas to understand the 
cultural politics of the primacy of the written text as patriarchal and exclu- 
sionary.’° Conquergood theorized the shift from reciting “literary” written 
texts to a performance of narrative—bodily stories—moving the domain 
of ethnographic inquiry to participatory engagement, critical intervention, 
and performance ethnography.” The move also challenged the presentation 
of scholarship, refocusing beyond the printed monograph to also consider 
the recitation of field notes, the performance of participants’ interviews, and 
a reflexive turn to include narratives of “doing” the research. And even more 
significantly, the recognition of the fluidity of “power” and its manifesta- 
tions in fieldwork experienced profound change. In the domain of research- 
ing the “other,” scholars shifted emphasis from subjects to coparticipants, 
coresearchers, and, derived from Zora Neale Hurston, cowitnesses to the 
documenting, moving, and making of culture.** The participants became 
speaking subjects, not objects being spoken for. Oral interpretation moved 
from text to performance. 

When Hurston performed the folklore from her fieldwork to Boas, she 
was already at this epistemological, ontological, and even methodological 
moment. Furthermore, the embracing of Hurston’s performance embodied 
the archive, a topic recently interrogated by performance theorists as they 
contemplate other depositories of knowledges and histories. Verne Harris 
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is preoccupied with questions about archiving bodily sounds: What does it 
mean to archive unwritten languages, ritual songs, and chants? He resists 
the concept ofa physical, centralized holding place (i.e., archive) and instead 
endorses the continued visceral transmission of cultural variables through 
the teaching of such cultural performances through technology.” 

In that moment with Boas, Hurston disrupted the binary opposition 
that plagues academic discourse by eliminating boundaries between the 
scholar and the participants and making known the cultural politics of do- 
ing fieldwork and producing creative and accessible ways of (re)presenting 
scholarship and creating new texts. The use of technology allows scholars 
access to different raw materials to develop the creative, physiological, and 
visionary texts of interrogation. The definition of the griot becomes broader. 
The Dj at the Red Rooster spins. 


TRACK 4: Black Women Performing Blues 


She could hold a tune in the shower peck out a few bars on 
the piano and strum some decent chords on the guitar, 
but she was no maestro. 


— VALERIE BOYD 


You’d most likely be hard pressed to find anyone who would 
call her a great singer. 


— DAPHNE BROOKS, describing Hurston’s singing 


Zora Neale Hurston is considered a member of the “unholy trinity,” along 
with Billie Holiday and Bessie Smith. Angela Davis and Norman Denzin lo- 
cate the genre of blues music as performed ethnographic text.” Performa- 
tive texts are credible scholastic endeavors that articulate conditions of race 
and gender politics (in a form accessible to many); these performative argu- 
ments are based in lived experience and grounded in what black feminists 
label theories of the flesh. 

According to Alice Walker, “Zora belongs in the tradition of black women 
singers. .. . She followed her own road, believed in her own gods, pursued 
her own dreams, and refused to separate herself from ‘common’ people.”** 
The lyrical locutions of Holiday, Smith, and Hurston document and an- 
nounce the unaltered reality of black life. The effusive performances that 
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graphically call out love, sexuality, and even violence demonstrate the “in- 
tellectual independence and representational freedom” in the work of these 
great women.”* Such performances were never simply about aesthetics, al- 
though they were great performances indeed, but there is always slippage— 
the messiness that bespeaks the extemporaneous nature of the blues. Never 
performing the same song the same way allowed for audience participation. 
The blues are always off-kilter, always mirroring the ebb and flow and nu- 
ances of everyday life. When I listen to Hurston’s recordings—from the 
audio expedition with Alan Lomax and the work compiled during her stint 
with the Works Progress Administration (WPA) with Herbert Halpert—it 
is the imperfections, the background noise, the inserted questions, and 
her off-toneness that provide a fuller and more complete set of “data.” They 
shape an integral part of the performances that reflects both the nuanced 
nature of ethnographic work and the nuanced nature of everyday life. 

Hurston’s work as a scholar of black life is not only significant ethno- 
graphically, in that she embraces “studying” her own community, but it 
also records a period of migration of blacks to the north and west at a time 
when immigrants and the growing class of educated African Americans 
were leaving “their downward, down-home ways and traditions behind.” 
She writes that collecting folklore “would not be a new experience for me. 
[W]hen I pitched headforemost into the work I landed in the crib of negro- 
ism.”** Hurston recognizes the magnitude and importance of archiving 
and documenting such work. Yet she claims, “It was only when I was off 
in college, away from my native surroundings, that I could see myself like 
somebody else and stand off and look at my garment. Then I had to have the 
spy-glass of Anthropology to look through at that.” She later disrupts the 
concept of “spy-glass” for her concept of feather-bed resistance. Recalling 
the “speakerly text,” Hurston reveals how the black communities would en- 
gage in strategies of speaking-but-not-really-speaking to outsiders “coming 
to get information.” A feather-bed resistance, she says, is when “we let the 
probe enter, but it never comes out. It gets smothered under a lot of laughter 
and pleasantries.” > Maybe Hurston used her “insider” status to probe, or 
maybe she used her ability to participate in the community, to fully embody 
the experiences of many of her cowitnesses. Her method as performance 
insisted I am I be as a unit. 

The Federal Writers’ Project (FWP) was a program within the WPA, cre- 
ated by the Roosevelt administration to stimulate the U.S. economy during 
the Great Depression. One aim of the FWP was to preserve and document 
American folklore and traditions. The state of Florida folklore section was 
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not established until 1939; however, Hurston had already participated in 
two folklore audio expeditions with Lomax in 1935 and 1937.”° In 1939 she 
became an official member of the state of Florida’s FwP committee that was 
officially titled the Joint Committee on Folk Art’s Southern Recording Expe- 
dition. The audio materials were recorded on acetate disks spinning at 78 or 
33%: rpm. The irregular speeds of the recordings are perhaps due to the heat 
incurred during travel from Florida to Washington, D.C. In addition, the 
scratches of the tapes featuring Hurston’s voice influence the playback qual- 
ity of the sonic performance. The Florida Memory Project currently houses 
and provides access to some of this work, but the Library of Congress holds 
most of the audio from the FWP.” 

Hurston’s recordings are nuggets of academic materials, filled with bits 
from African American life in the South, including information about labor 
and the economic, religious, and social lives of southern blacks. The sounds 
include Hurston singing and performing chants (mostly of African Ameri- 
can railroad workers) and other speakerly, performative folkloric texts. For 
example, in the C recording, Hurston contextualizes the song and she per- 
forms it back to her cowitnesses. She is asked by audience members to share 
more about the lyrics. You hear the intermittent ideas and questions posed 
and then you hear her voice. Her brash utterance discloses her methodology. 
Someone asks, “Who taught you this song?” She replies, “Not one person.” 
Rather, she discloses how she “would sing along with the crowd and then 
perform it back to them to make sure [she] had it correct.” Representation 
is important to performance ethnography. Contemporary performance eth- 
nographers return to the communities in which they work to ascertain ifthe 
final product (play, article, image, video) truly represents who the subjects 
are. Yet Hurston resisted her training with Boas, who was adamant about 
recording “the other,” and the act of recording herself radically reframed 
the topic of representation. Hurston refused to translate the other through 
technology: instead we get her—Hurston the anthropologist, folklorist, 
interlocutor, and also Hurston the community member familiar with lives 
and culture of this particular population. The aim in Hurston’s ethno- 
graphic reality is not authenticity but a realization of the contested nature 
of doing and the mere presentation of ethnographic inquiry. The digitized 
audio collection of the Florida expedition is an invitation to a dialectic aural 
performance, yet it highlights some of the challenges as to how to engage 
with Hurston’s audio work. 

In “Let the Deal Go Down” we geta sheer sense of Hurston’s embodiment. 
In this song about gambling (connected to the card game “Georgia skins”), 
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Hurston rehashes the folkloric tale, and then she explicates how the song is 
literally performed as she embodies several characters sitting around a table 
to give the audience a real sense of the context. The listener surmises the in- 
terplay of community and economics in the rural South. Yet in “Let’s Shack,” 
the arch of Hurston’s voice as she emits the hard “HAAA” and the short, 
abrupt phrases eclipsed by hard constant sounds evoke the hardship of 
labor on the railroads. I should also note that Hurston desired to document 
every aspect of black life. Some recordings from FwP and the expeditions 
with Lomax are not accessible online because of the bawdy subject matter. 
The digital is a contested space. Digital conversions do not exclusively guar- 
antee accessibility. Even at this moment of collusion between reality and 
technology (simulacra), the cultural politics of technology, particularly in 
the context of the United States, continues to struggle with power. Who has 
the right to decide what is acceptable, what is scholarship, and what rele- 
vance certain materials hold? In addition, exclusionary politics ensures that 
everyone does not have access to digital materials. The performative nature 
of the sound—including the meta-analysis that Hurston herself provides, 
her visceral embodiment, and her attempt to make the work assessable in a 
variety of forms—positions her work in the synchronous I am I be, not sepa- 
rating the object from the subject. 

Earlier in this chapter I revealed that my introduction to Hurston was 
through the paralinguistic oral qualities of her written texts, a writing that 
evokes the essence of sounds through embodied sensual performances. But 
it was the digitized sound recordings from the expeditions that profoundly 
influenced my academic work, from my ethnographic fieldwork (Brazil/ 
Haiti) and my research topics (ritual performance) to the presentation of 
my scholarship (installation, plays, sound). As a researcher, I find the area 
of digital sound studies considers even more ways to critically interrogate 
Hurston’s digital work, particularly in the areas of scholastic presentation 
along with gender and race. 

Hurston’s audio work is scholarship. Her ability to record, produce, 
and disseminate her work in multiple ways suggests a different type of 
“writing”—a scholarship that surpasses an impression on a sheet of paper 
to signify the echoes of the jots and scratches on the page. Her recognition 
as a model performance ethnographer is (as I mentioned earlier) not simply 
because of her creative methods but also because of the presentation of 
her work. Her collection of sounds from the American South to the Haiti 
expedition should stand alone as academic scholarship. The FwpP, to which 
I referred earlier, holds one of the few collections in which Hurston pro- 
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vides a meta-pedagogical explication of the folklore; yet in the Haiti work, 
which is considered the first exhaustive and descriptive account of Haitian 
Voudou, the recordings offer limited annotations. The sounds of the ritual 
performances stand alone, inviting the listener to participate in a dialogue 
of the seamless stream of chants, dances, and prayers in Haitian Kreyol. 
Interestingly, in her printed work Hurston cites very little, if any, from her 
audio documentation, but rather relies on her written personal engagement 
with such ritual performances to document her fieldwork. The aural and the 
written overlap and stand parallel to be sure, but they provide two diverse 
and distinct academic projects on the topic of Voudou and Haiti. The written 
Hurston has been privileged in academic corridors, but the aural Hurston 
is just as valuable and rich and provides a plethora of data not addressed in 
her printed work. 

The digitized Hurston is accessible, if one can find her. Unlike the Jazz 
Loft Project, most of Hurston’s digitized recordings have not undergone ex- 
haustive and comprehensive cataloging and encoding.” Perhaps one reason 
is that her digital sound recordings exist under the auspices of others such 
as Alan Lomax and Herbert Halpert, two white men. The American Folklife 
Collection (of the Library of Congress, which houses the sound collection 
of the Lomax, Hurston, and Barnicle expedition of 1939) lists Hurston as re- 
corder, interviewer, and collector.” The project description of the Southern 
States (WPA) recordings (also in 1939), led by Herbert Halpert, cites Hurston 
as one of the recorders.* Yet the official Library of Congress Folklife Center 
catalog lists Halpert as the sole recorder and archivist." In one of his final 
interviews, Stetson Kennedy, who directed the wpa “America Eats” project 
in the South—which was also under the auspice of Halpert—recalls that 
because of Jim Crow he dispatched Hurston alone to African American com- 
munities to record culinary practices.** The writings and photographs of 
this project have garnered attention, but the vast audio archive from “Amer- 
ica Eats” has yet to be exhumed. Hurston’s position as female and African 
American profoundly influences the accessibility and legibility of her work. 
To find her digital sound work is to go through the work of others. Yet to 
fully begin to explore the range and significance of Hurston’s sound work 
is also to contemplate the race and gender cultural politics of her time and 
now, in the twenty-first century. I recall the news in 1997 when unpublished 
plays and essays by Hurston were “found” in the Margaret Mead audiovisual 
collection in the Library of Congress.” I remember Alice Walker’s search 
for and discovery of Hurston’s unmarked grave (a quest that brought greater 
attention to Hurston’s literary work). Yet Hurston’s available digitized audio 
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work is placed in the archives of others, some contributions marked, some 
unmarked. Unlike the sliver of Hurston found in the “America Eats” project, 
most of her audio remains uncataloged, an omission that limits the knowl- 
edge of Hurston’s generative work. 


TRACK 5: Zora, Digital Sound, Remix 


As an artifact, recorded audio produces an aura of authenticity or realness 
and even a sense of beauty for the listener. In my first encounter with hearing 
Hurston’s voice from a digitized recording, I felt a sense of intimacy, a new- 
ness of wonder of what her life must have been like at that time and place. A 
sense of excitement and eagerness to share the “folklore” exudes from her 
voice. The imbalance of recording speed along with the extraneous distant 
and sometimes not-so-distant sounds adds to a sense of awe and mystery 
surrounding Hurston. Through performance one might consider the objects 
used in the recording: why that particular recording device (its history, com- 
mercial use), how it was used in the exchange with Hurston, and what its 
interpellations meant for contemporary audiences in their everyday lives. As 
with the mystery that continues to surround Hurston’s personal story (her 
ability to obscure fact with fiction in documenting her own life—her date 
of birth, number of marriages, etc.), she brilliantly and strategically used 
performance as a means of obtaining her desired goals from specific audi- 
ences." Performance as a form of analysis at its core interrogates the precept 
of goal and audience, a position clearly embraced by Hurston. Equally, her 
digitized voice evokes beauty; her off-toneness and imperfections conjure 
the traditions of blues music performance. As with most of her work, the 
recordings disrupt the concept of a standard of beauty for a preoccupation 
with the haunted space between form and content. Like the sonic mix weav- 
ing Hurston’s voice at the Red Rooster, the digitized sound recordings allow 
for more performances of her voice in more venues, with each performance 
spawning divergent and diverse ways of engaging with her and unearthing 
more about her. Derrida appends a prospectus on hauntology in On Hospi- 
tality, in which he makes a compelling case for engagement with the thing 
(the other). Ultimately, he suggests, sincere engagement will produce an 
endless stream of discourses, readings, and interpretations. The sound mix 
the DJ was spinning at the Red Rooster on that winter evening continues to 
haunt, not only as a confluence between digital and humanistic inquiry but 
also in its creation of a performative space made possible through technol- 
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ogy and sound. In this moment of “re-,” consider the multifaceted nature of 


sound and the enhancement of humanistic inquiry with digital technology, 


as we recall and remember those whose contributions could be lost, hidden, 


or unmarked. Patricia Hager recognizes Hurston as museum—a reservoir of 


folklore, history, a preserver of culture. 
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30 See “Florida Folklife from the wpa Collections.” 

31 See Lomax etal., “Lomax-Hurston-Barnicle Expedition Collection.” 

32 For more information about the audio “America Eats” project, see Nelson and 
Silva, “‘America Eats.” 

33 See Margaret Mead audiovisual collection (accessed January 13, 2018, www 
-loc.gov/today/pr/1997/97—065.html). 

34 Kaplan, Zora Neale Hurston. 

35 Derrida and Dufourmantelle, De Lhospitalité. 
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RHETORICAL FOLKNESS 


Reanimating Walter J. Ong in the 


Pursuit of Digital Humanity 


JONATHAN W. STONE 


I begin this chapter with a confession. 

I am a lifelong fan of Phil Collins, the British drummer turned pop 
superstar. 

Since I moved on from grade school—when “Against All Odds” was a 
radio hit and such an affinity still had social cachet—my fandom is a secret 
I have been able to conceal with limited success over the years. I keep my 
public listening contained to headphones, but my neighbors know. They 
heard me through an open window singing “Sussudio” in the shower, and it 
is not something I am likely to live down. 

Recently, while searching YouTube for interesting Phil Collins tunes, I 
stumbled on a compelling version of “In the Air Tonight” sung by the choral 
group Choir! Choir! Choir! c!c!c! is an ad hoc ensemble that meets in a bar 
in Toronto once a week to sing pop music. The group was formed by Dav- 
eed Goldman and Nobu Adilman and modeled after an Argentinean pefia, 
which, as Goldman explains, “is just a place where people can go and hang 
out, even at three o’clock in the morning, and sit at tables with their guitars, 
drinking red wine or Coca-Cola, and stay up all night singing Saltefio folk 


songs.”* Goldman and Adilman’s choir operates on a completely volunteer, 
no-audition basis. Folks just show up and sing. Adilman directs the group 
and Goldman accompanies on guitar. Together, they arrange the harmonies 
and make the song selections, which range from A-ha’s classic “Take On 
Me” to Robyn’s more contemporary “Dancing on My Own.” 

In a 2012 NPR story on the group, Adilman relates that the choir started 
with just twenty participants but quickly grew to a group of over a hundred 
singers. In the piece, c!c!c! members speak of the ways that the group be- 
came a thriving and meaningful community for its participants—a kind of 
musical refuge—and how the group filled a gap in their social lives. Since its 
formation and success, Goldman and Adilman now frequently take c!c!c! 
into the larger Toronto community where they perform in hospitals and for 
veterans and other groups. In February 2016 the choir raised C$60,000 for 
Syrian refugees seeking safety in their city. In addition to this community 
outreach work, c!c!c!’s musical rhetoric has been used in both satire and 
eulogy. In 2014 they posted a slightly revised version of Sting’s “Russians” in 
response to Vladimir Putin’s homophobic comments about LGBTQ athletes 
participating in the Sochi Winter Olympics, and in 2016 c!c!c! honored the 
memory of Prince by inviting 1999 people to join them ina stirring rendition 
of the late singer’s “When Doves Cry.” Much too large to fit in their regular 
barroom, this expanded c!cic! filled Toronto’s Massey Hall. 

In my initial YouTube encounters with c!c!c!, I was moved by the ways 
that they projected a rare spirit of participation, care, and celebration of 
shared cultural experience. That spirit reminded me of the work of another 
favorite (much more socially acceptable) artist of mine, Pete Seeger. For over 
seventy years Seeger was an ambassador of vernacular music, an amplifier 
of marginalized voices, and an untiring advocate for cooperation—for 
coming together in both song and labor to remember history and plan for 
the future. cic!c!’s undertaking resonates with Seeger’s values. They are a 
diverse group and not particularly virtuosic, but when you hear them it is 
clear they have spent time and care rehearsing the songs in their repertoire. 
Aside from our shared love for Phil Collins, I was surprised by my strong 
emotional response to the group’s performances. I never cared much for 
Gordon Lightfoot’s “If You Could Read My Mind,” for instance, or thought 
to juxtapose it with “Basket Case” by Green Day, but re-presented in this 
context, those tunes took on a vibrant quality, a kind of digital vernacular 
newness. I use the term “vernacular” here in its most basic sense to mean 
“everyday language,” but Houston A. Baker’s definition is also useful. He 
describes vernacular expression in contrast to “high art” as “arts native 
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or peculiar to a particular country or locale.”? c!c!c! brings together two 
distinct vernacular practices, two “locales” of shared public experience: 
popular music and the digital interface. In a strange but unmistakable way, 
the group’s YouTube channel has become a spontaneous digital archive of 
late twentieth and early twenty-first-century popular culture, which many 
of us are still ensconced within. More than a playlist on iTunes or a mix 
CD you might give to a friend, the embodied nature of community singing 
stored and shared on the public network of YouTube is affecting, drawing 
me in as a proxy participant. I spent time not just listening to the group but 
also singing along. In fact, I was inspired to try it out myself. Soon after 
discovering c!c!c! I brought a guitar and a pile of lyrics sheets to a friend’s 
party and, without much prompting, had twenty people singing “In the Air 
Tonight” on a porch in Champaign, Illinois. It turns out I’m not the only one 
with a secret. 

Choir! Choir! Choir! and similar groups embody an overlap between pop- 
ular culture, sound as orality, and the archive that is only beginning to be 
imagined and activated, let alone theorized, within our contemporary digi- 
tal culture. The Toronto-based project is a powerful example of what might 
be called “digital humanity”—a kind of vernacular residuum resulting from 
the same digital affordances, technologies, and methodologies now being 
utilized and studied by the emerging institutional formation called digital 
humanities. Ungoverned by any institution or discipline, digital humanity 
describes the myriad ways humans are linked together digitally through the 
common cultural experiences, tools, networks, and technological ambience 
of the electronic age. C!c!c! brings together the rhythms of popular music 
with the algorithms of the digital archive and in doing so becomes part of 
the growing and indelible imprint of digital affordances on human memory- 
making and -keeping. C!C!C! represents just one of many ways the human 
coalesces with the digital to preserve, enhance, and perpetuate the rhythms 
of cultural memory and, by extension, the refrain of human values. 

This chapter is my response to the call from the editors of Provoke! for 
essays to better understand digital sound studies by tracing deep histories of 
digital sound technologies and their predecessors and also to critically eval- 
uate how technology continues to shape auditory culture. To this end, I draw 
together concepts from ancient and contemporary rhetoric to theorize and 
historicize this notion of digital humanity for the future of digital sound 
studies. The rhetorical tradition has been underutilized as a tool for under- 
standing sound in the larger field of sound studies—an oversight I believe 
is (at least in part) tied to the disavowal of Walter J. Ong in prominent sound 
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scholarship. I will argue that Ong anticipated the current media landscape, 
including the circumstances I have designated as digital humanity, and that 
he tied these contemporary mediated realities to both sound studies and 
rhetoric.* 

A concept like digital humanity is plausible only because its evidence is 
everywhere. Everyday lives are becoming more and more reliant on digital 
tools, not just for connecting and relating to one another, but also in the 
rhetorical practice of preserving and propagating cultural values and sys- 
tems of civic belief. Digital humanity is integral to this emergent vernacular 
digital culture and, as I will argue, can be understood and made useful for 
sound scholars in terms first conceptualized by ancient rhetoricians, and 
then retheorized by Ong. Given Ong’s fall from scholarly fashion, I will 
tread carefully if deliberately through that critique in order to articulate a 
future of digital sound studies that is open to both rhetorical interrogation 
and a remixed and reanimated Ong. This reanimation, I argue, will help 
to forge an incipient bridge between sound studies and rhetoric based 
around a reconceptualization of Ong’s sonic theory of secondary orality, 
one Ong rooted to sound and rhetoric. In other words, Ong’s theory reminds 
us what is rhetorical about sound studies. Rhetoric, generally studied as a 
tool for persuasion, also has deep connections to sonic ways of value- and 
knowledge-making. As such the field of sound studies—particularly at the 
cutting edge of its marriage of the vernacular and the digital—can be better 
understood and articulated when rhetoric is included as part of the field’s 
conceptual Pro Tools. 


Reanimating Walter J. Ong 


Once known as a preeminent sound theorist whose “version of the ‘great 
divide’ between orality and literacy [for a time] dominated the approach to 
literacy,” Ong now occupies a tenuous position within the fields of literacy 
studies and sound studies.’ In fact, Ong has become a kind of Phil Collins 
figure: both had hits in the 1980s, and while many of us know the words 
and can sing along to both, it is becoming harder and harder to admit it in 
public. 

Ong was associated with Marshall McLuhan and the influential To- 
ronto School of communication theory.° As such, he emphasized key epis- 
temological differences between orality and literacy, arguing for the need 
to “reawaken the oral [and sounded] character of language” within the 
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scholarly world. He taught that an emphasis on visual, literate (and by exten- 
sion, logical, empirical, and positivistic) epistemologies led to a diminished 
understanding of oral/aural types of knowledge. Ong argued that the sound 
of the voice is an essential feature to understanding humanity and that “the 
phenomenology of sound enters deeply into human beings’ feel for exis- 
tence, as processed by the spoken word.”’ These claims won the theorist wide 
acclaim as an innovator and, fora time, helped to bring sound into scholarly 
vogue. However, critics have since maligned Ong and his contributions as 
part ofa larger grouping of misguided “phonocentrists” who mistake voice 
and sound for a metaphysical and mythic presence. One of the more notable 
critics, Jonathan Sterne, describes Ong’s position as theocentric and as part 
of an “audiovisual litany” that seeks to privilege sound over visuality in a 
kind of hierarchy of the senses. For Sterne, Ong’s championing of orality 
is merely “a restatement of the longstanding spirit/letter distinction in 
Christian spiritualism.”* Sterne’s perspective is persuasive, and his voice, 
alongside those of other prominent critics, has contributed to Ong’s work 
falling out of scholarly fashion.’ 

Seeking to “recover” Ong or to rationalize his spiritualism would be 
futile. He was, after all, Father Ong—a Jesuit priest—and he would not have 
felt compelled to rationalize his spiritual focus either. Instead, in much the 
same way that c!c!c! brought Phil Collins into a new sonic space, it is more 
useful to reanimate and redress Ong’s intellectual contributions within a 
secular, rhetorical paradigm, directing attention to the ways he connected 
his theories of sound to a more technologically diverse understanding of 
human flourishing—to digital humanity. Ong’s work is important not so 
much for the ways that he tended toward essentialism but in the ways that 
he understood and began to theorize contemporary society as a hybrid of 
the traditional and the technological and what that hybridity might have to 
teach us about human value-making as we move deeper into the electronic 
age. 


THINKING CONJUNCTURALLY: Epideictic Rhetoric, Folkness, 
and Ong’s Secondary Orality 


I have already used the term “digital humanity” to gesture toward the ways 
that people utilize technology to generate new knowledge, tools, and net- 
works for understanding the world and other people. However, the notion 
that these behaviors lead to the disruption, modification, and even creation 
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of new systems of value has ancient origins. Aristotle conceptualized the 
deep, humanistic work of belief formation and propagation as a species 
of rhetoric he called epideiktikon, or “epideictic,” and he used the word to 
describe the value-making oratory inherent to ceremonial, ritualistic, and 
poetic discourse. “Epideictic” remains common parlance in rhetorical crit- 
icism, but there are many synonyms across the disciplines. In the 1950s and 
60s, for example, musicologist Charles Seeger used the word “folkness” 
in much the same way. Echoing Aristotle, Seeger defined folkness as the 
“funded treasury of attitudes, beliefs, and feelings toward life and death, 
work and play, love, courtship and marriage, health and hearth, children 
and animals, prosperity and adversity—a veritable code of individual and 
collective behavior belonging to the people as a whole.”*° While this defini- 
tion hails from a particularly poignant moment of folk revival, I contend that 
it points to a more or less universal idea about the ways that humans build 
systems of value and public memory together in vernacular, or everyday, dis- 
cursive spaces. Neither epideictic nor folkness is inherently sonic, but both 
have a close historical relationship with sounded and rhythmic expression, 
which can also be found commonly at the vernacular level, particularly when 
paired with rhetorics of remembering. Sound’s rhetorical folkness is alive 
and well within digital culture-making. It is at the heart of c!c!c!’s ethos, 
for example, but it can also be found in any user-generated or open-source 
community where memory making and memory keeping have become a 
public affair due to the increasing ubiquity of electronic affordances: smart- 
phones, inexpensive high-definition sound and video recording devices, and 
networked platforms such as YouTube. For example, consider “OutKasted 
Conversations,” Regina Bradley’s YouTube archive of public conversations 
about the hip-hop group OutKast and contemporary black southernness. 
“OutKasted Conversations,” addressed in chapter 5 of this book, brings to- 
gether a number of sonic elements—OutKast’s music, digitally mediated 
conversation, and user-generated comments—all of which contribute to the 
rich digital humanity of Bradley’s work and archive. 

In his 2013 collection The Sound Studies Reader, Jonathan Sterne asserts 
that a primary goal for the future of sound studies should be to “think con- 
juncturally about sound and culture.”** I have been working here to draw 
connections, then, between disciplines and terms in order to map these 
potential conjunctures. Ong also worked conjuncturally, making explicit 
the connections between value-making, rhythmic sound, memory, and 
technology in his recurring notion of “orality.” Orality was derived from 
the system of thought known as “media ecology,” a central philosophical 
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tenet of the Toronto School.” Media ecology’s trajectory holds that techno- 
logical mediation is central to understanding the development of human 
consciousness and has traversed four major “ages”: tribal, literate, print, 
and electronic. Operating mainly within the trajectory of Western cultural 
history, Ong’s work deals in large part with the transition between each age, 
and relabels “tribal” with his term “oral.” Ong was fascinated by the liminal 
moments between the ages—with the profound transference that occurs 
as one dominant mode of communication gives way to the next. We can 
get a sense for Ong’s modus operandi in the title of what is arguably his 
most intellectually enduring work, Ramus, Method, and the Decay of Dialogue: 
From the Art of Discourse to the Art of Reason (1958). In Ramus, Ong chronicles 
the cultural impact of the printing press, which included a shift from the 
dominance of speech and dialogue in the public sphere and led, through 
new emphases on method and “reason,” to the cultural circumstances that 
directly preceded the Enlightenment. For Ong, the historical trajectory 
that began with preliterate culture and continued through the age of print 
always includes a steady march away from “aural-type phenomena” and 
toward ways of knowing structured by “visual-type” methodologies and 
the abstract thinking made possible by the affordances of literacy and, by 
extension, technology.” This was the case, at least, until the mid-twentieth 
century and the dawn of a new age. 

Ong develops the notion of “secondary orality” as a way of describing the 
state of human consciousness in the then-emerging electronic age in which 
the visual’s dominance was beginning to wane. The electronic age is one im- 
bued with a “high-technology ambience,” where “a new orality is sustained 
by telephone, radio, television, and other electronic devices that depend for 
their existence and functioning on writing and print.”** Ong gives primary 
and secondary orality as key concepts for understanding the impact and per- 
mutations of media ecology’s continuum across history. Secondary orality is 
“new” because technological advance brought sound back into prominence 
within communication technologies in a way not emphasized since the days 
of ancient, or “primary,” orality. 

Ong’s writings on secondary orality, however, are somewhat limited. 
Ong scholar and rhetorician Abigail Lambke argues that “secondary orality 
should be read as incomplete, suggestive, and germinal” (and this, perhaps, 
is the right approach to working with Ong in general). Lambke points to- 
ward two particularly cogent elements within Ong’s cursory beginnings 
that help define this slippery term." First, Ong writes that “new orality has 
striking resemblances to the old in its participatory mystique, its fostering 
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of a communal sense, its concentration on the present moment, and even 
its use of formulas.” Next, secondary orality also “promotes spontaneity 
because through analytical reflection we have decided that spontaneity is 
a good thing. We plan our happenings carefully to be sure that they are 
thoroughly spontaneous.”** Rendered this way, secondary orality reminds 
us that humanity, as we currently experience it, is a mix of both traditional 
and progressive paradigms and cannot be otherwise. Digital humanity, 
then, reveals itself within this symbiosis of the past, present, and future 
as emerging technologies present opportunities to participate in, preserve, 
and be “conspicuously spontaneous” in our various technologically en- 
hanced social interactions. 

Recall again the ways that Toronto’s Choir! Choir! Choir! embodies each 
of these elements. Participants gather together in planned spontaneity to 
sing. Their performances are recorded, archived on YouTube, and thereby 
distributed to the world where we can then participate with them and even 
emulate them in our own communities. This is in many ways a stunning 
reversal of the prediction made by Robert Putnam in his popular book 
Bowling Alone, published at the dawning of the twenty-first century. Instead 
of bowling alleys emptying of people due to technology’s “individualizing” 
tether, people are gathering in public places to perform the ways technology 
brings them together in common folkness.”’ Indeed, digital networks like 
YouTube are pulling dispersed individuals into purposive communities and 
enabling the singular voice of radio, television, and internet to become a 
collective one. 

And YouTube is not the only space where technological advance is cre- 
ating new communities of participatory sonic culture. The Berlin-based 
online audio distribution platform SoundCloud, for example, has become 
a hub for musical collaboration, sample sharing, and new-artist promo- 
tion and has a reported forty million registered users and five times that 
many listeners.** Also, smartphone platforms such as Instagram, Vine, and 
Snapchat, which allow for the quick and simple distribution of vernacular 
sound and video to a large audience, also meet these criteria (as do video 
streaming apps like Twitter’s Periscope and Facebook Live). With seventy 
million users (and before its abrupt demise), Vine had become so popular 
and ubiquitous as to have produced its own “stars”—fascinating evidence 
of a vibrant community drawing on both traditional (celebrity culture) and 
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emerging paradigms of interaction (“followers,” “revines,” and “likes”). 
And while digital platforms and apps are perhaps the most conspicuous 


places to locate digital humanity, they are not the only places public sonic 
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archives emerge. Libraries and community centers are beginning to invest 
in open-to-the-public facilities for digital content creation and sharing. The 
St. Louis public library, for example, recently opened a recording studio— 
open to anyone with a library card—that has become a popular hub for 
recording both music and other sonic projects." These various shapes and 
sounds of digital humanity also represent a realization of Ong’s predictions 
for orality’s sweeping communal and participatory potential when sounded 
through contemporary technologies. 


Memory, Archives, and a Step Beyond Secondary Orality 


In many ways Ong relies on his audience to intuit a sense of what secondary 
orality entails by following along carefully with his development of primary 
orality. Whether primary or secondary, “orality is orality in some ultimate 
sense,” Ong quips with his trademark essentialism, and we are left to assem- 
ble the pieces on our own.” Ong’s interest in the sonic experience of orality 
is often tied to a deeper human interest in technologies of remembering. 
And while Ong had an implicit preoccupation with spiritual remembrance 
(or not forgetting God), we need not be spiritualists to find some insight and 
value in the importance of memory and its connection to sonic activity. Ar- 
chives, for example, offer an important site for understanding the negotia- 
tion, interplay, and overlap between memory and data, a dichotomy that fits 
more or less analogously beside the notions of orality and literacy, tradition 
and progression, folkness and technology—all ideas that I have been en- 
gaging here. Orality, if tied to our understanding of the archive, loses much 
of the acrimony the concept receives from Ong’s critics. After all, even be- 
fore digital or material archives, humans used their memories as archives 
to preserve important cultural knowledge and also to carefully organize 
the memorized elements of an eloquent oral performance (a practice that 
continues).7* 

Ong develops orality’s relationship to human memory’s potential as an 
archive along two disparate but related trajectories, one with anthropologi- 
cal ends and the other rhetorical. Each is concerned with what Ong and other 
media ecologists call “oral-formulaic composition,” or the use of rhythmic 
formulae as a way of preserving memory, knowledge, and culture. Ong 
jumps to some problematic conclusions in his anthropological research that 
seem to suggest that literacy develops with clean evolutionary determinism 
across all cultures, in predictable patterns, and always toward alphabetic 


72 + JONATHAN W. STONE 


literacy.” This paradigm has come under significant critical scrutiny, the 
sharpest of which is from ethnographer Brian V. Street, who sees much of 
Ong’s work as methodologically reductive, empirically weak, theoretically 
deterministic, and based on assumptions about cultures he knew little of. 
Ina like manner, this (pseudo-)anthropological line of thinking does not do 
much to advance the development of secondary orality. 

Within the rhetorical tradition, however, Ong argues that oral formulas 
as “knowledge storage and retrieval devices” have a rich history.* Ong con- 
nects the orality of ancient rhetorical theory to the secondary orality of his 
twentieth-century moment. The rhetorical tradition has its roots in ancient 
poetic traditions in which the formulaic and rhythmic memory aids, fash- 
ioned as oral mnemonic devices, passed as oral tradition from the Homeric 
epoch to into later antiquity. The use and memorization of poetic figures 
(commonplaces) and the use of carefully curated topoi (topics) are well- 
documented practices in both the teaching and performance of rhetoric in 
ancient Athens. Writing about the methods of ancient teachers of rhetoric 
known as the Sophists, George Kennedy relates that even “as the composi- 
tion of oral poetry and the oratory in it was built up with blocks of memo- 
rized material adapted to a variety of situations, so sophistic oratory was to 
a considerable extent a pastiche, or piecing together of commonplaces, long 
and short.”*> Aristotle cataloges many of these “formulary materials” (as 
Ong calls them) in his Rhetoric, written in the fourth century BCE; he was 
followed in this practice by Roman orator-teachers Cicero and Quintilian in 
the first century of the Common Era. 

Writing at the end of the 1960s, Ong points to the folk revival—to 
folkness!—as a site of secondary orality where this same kind of oral- 
formulaic discourse of public memory reemerges. For Ong, the appeal of 
folk song “derives from the overwhelming persuasion of its devotees that 
it is of great antiquity (often it is not) and connects with their past.”?° In 
the United States, folk “revival” in the early and mid-twentieth century 
revolved around the search for and archiving of vernacular artifacts that 
reverberated with the cultural memory cataloged in Charles Seeger’s earlier 
definition, but it also engaged with a kind of longing for authenticity. “Folk- 
life” archives have become an important part of countless communities 
and are housed (often with digital components) in libraries and universi- 
ties across the United States, with the preeminent example at the Library 
of Congress. Ong, however, pushes past the idea of folklife as something 
that should only be engaged within a careful, cataloged archive and moves 
toward a more dynamic folkness of innovation, satire, improvisation, and 
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play that begins to emerge as part of the rhetorical life cycle of figures and 
commonplaces—including their eventual decay and/or descent into cultural 
cliché.” Digital sound studies should be similarly postured toward sound’s 
various permutations as shaped by and through digital platforms and tools 
(which is important work), but sound studies should also seek to under- 
stand how those sonic permutations are resonant with and respondent to 
the dynamics of folkness mentioned above. This orientation is distinctly 
rhetorical, as sound’s radical potential for influence is tied (here rephrasing 
Aristotle’s famous definition of rhetoric) to the perceived uses for and mal- 
leability of the figures and commonplaces of shared cultural memory in any 
given scenario.” One brief, humorous example of this might be found on a 
recent horror-film forum in the open-source sound community freesound 
.org. Freesound allows users to post sound files and respond to requests for 
specific sounds and music needs. Foley artist AlienXXX posted a one-second 
audio file titled “Blood_splat_or5b.wav” with the following description: “I 
had a sound request for a ‘bloodsplat.’ Created these sounds by throwing 
small portions of water or wet sponge. Recorded with a Zoom Hi.”” In this 
instance, and in many others like it on freesound.org, user interactivity 
and sound productions are respondent to user need and request. In the 
process of creation mediated through freesound’s forums, communities 
form, disperse, and reform to the ebb and flow (and blood splats) of digital 
humanity. 

Here again, Phil Collins becomes a useful lodestar for further under- 
standing of and engagement with how this process works. Over the last 
half-century we have circulated at least once or twice through what now 
appears to be the revolving cycle of secondary orality: from the earnest 
seeking of authenticity, through satire and irony, to innovation and play, 
and back again. Other closeted Collins fans will remember that before his 
solo career took off, he performed as part of the progressive rock group 
Genesis, whose members were known for their innovative musicianship 
and frequent political themes. As a solo artist, however, his popularity 
reached its peak during a brief period of (now cringe-inducing) earnestness 
during the 1980s. Since then, however, Collins’s music has remained in the 
popular sphere, in karaoke bars and among community sing groups like 
c!cic!, to be sure, but also as samples in the work of hip-hop Djs and Mcs. 
In fact, my favorite song, “In the Air Tonight,” has been sampled by Dmx (“I 
Can Feel It”), Lil’ Kim (“In the Air Tonite”), Nas (“One Mic”), and even the 
legendary 2Pac (“Staring through My Rearview”).?° Collins’s work takes on 


74 > JONATHAN W. STONE 


new life as a Dy’s sample. When juxtaposed with hip-hop lyrics and themes, 
the song functions as a common cultural touch-point—a backbeat—useful 
in response to (and even subtle commentary on) evolving exigent issues. 
“In the Air Tonight” carries the broad cultural marker (or commonplace) 
of emotional intensity, which can be taken up, reworked, and deployed in 
the praise and blame—the epideictic critique—of shared values within and 
across U.S. popular culture. 2Pac’s lyrics, “I wonder when the world stopped 
caring last night / Two kids shot while the whole block staring,” rapped over 
the iconic keyboard and drums of “In the Air Tonight,” are indisputable as 
poignant oratory and an example of what contemporary epideictic rhetoric 
sounds like. Collins’s work, then, is part of a revolving cycle of rhetorical 
folkness: from innovative art to tired cliché and back to art—but in new keys 
and accompanied by new voices. 

The folkness of digital humanity, which exists, perhaps, as a step beyond 
secondary orality, takes advantage ofa technologically hybrid culture where 
knowledge/retrieval systems (or “external memory” as we are now wont to 
call it) have become ubiquitous. In other words, digital humanity is evident 
in the kind of technical literacy and rhetorical fluency central to the DJ’s 
expertise (mash-up/remix) and can be observed across media and in digital 
discourse of the everyday. This notion of digital humanity invites a new and 
emergent folkness that embraces, circulates, and rearticulates each of these 
stages ad infinitum, forever blurring the lines between tradition and progres- 
sion. Harkening back to both Aristotle’s and Lambke’s insights, while the 
ever-changing folkness of digital humanity creates unprecedented opportu- 
nities for participation and spontaneity—from open-source software builds 
to open-audition community choirs—this radical openness also requires 
new ways of understanding the dissonance of this potential cacophony of 
competing voices and values. Here rhetoric’s concepts and theories, starting 
with epideictic and blossoming outward, can provide both perspective and 
conciliatory resonance to these issues as well as those within conversations 
around digital sound studies more broadly. As mentioned earlier, Ong re- 
minds us what is rhetorical about sound studies. His anticipation of these 
technologically imbued circumstances and phenomena, his use of rhetoric 
and rhetorical history to understand and situate them, and his open notion 
of secondary orality as the mode in which they can be theorized are ample 
justification for a reconsideration and reanimation not only of Ong’s work 
in relation to digital sound studies scholarship but also of rhetorical studies 
more broadly.** 


RHETORICAL FOLKNESS =: 75 


Consider, in conclusion, how Ong’s view on technology (which always 
exists as a demonstration of the hybridity of oral and literate ways of think- 
ing) speaks to this justification: 


Technologies are not mere exterior aids but also interior transformations 
of consciousness, and never more than when they affect the word. Such 
transformations can be uplifting. Writing heightens consciousness. 
Alienation from a natural milieu can be good for us and indeed is in 
many ways essential for full human life. To live and to understand fully, 
we need not only proximity but also distance. This writing provides for 
consciousness as nothing else does. 

Technologies are artificial, but—paradox again—artificiality is natu- 
ral to human being. Technology, properly interiorized, does not degrade 
human life but on the contrary enhances it. The modern orchestra, for 
example, is the result of high technology.” 


Phenomena suchas acicic!, freesound.org, and the DJ sample (and, for that 
matter, Phil Collins and Walter Ong themselves) exist along a continuum of 
mediated experience that includes activities that look and sound like Ong’s 
descriptions of primary and secondary orality. I do not need to subscribe to 
Ong’s spiritual ideals to find something transcendent and human about the 
activities implied by these terms, their various permutations, and the ways 
that they relate across that continuum. On the other hand, subscribing to 
and expanding on Ong’s frequent use of “rhetoric” to account for the com- 
plexity of oral and aural experience has immense potential. This chapter has 
been about drawing that potential out, connecting rhetorical terms to sonic 
experiences, and beginning to theorize the folkness of digital humanity. 
As we look toward the future of digital sound studies, each of the above 
frameworks, from secondary orality to digital humanity, usefully conceptu- 
alizes the various ways that contemporary vernacular culture is embedded 
within, performed through, and transformed by digital technology. For 
those in sound studies, an orientation that acknowledges the inherent 
folkness of those technologies is, as I have sought to show, a rhetorical 
orientation. As such, this rhetorical folkness is resonant within digital 
technologies as the coalescing rhythms and algorithms of past and present 
memory/value systems resounding in and beyond the code. Within these 
systems (archives and revolving traditions), groups like Choir! Choir! Choir!, 
platforms like YouTube, and samples by Phil Collins can be understood not 
only as sites for the careful study of sound’s digital potentials but also as 
the raw materials available for the crafting of new and rich digital rhetorics. 
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NOTES 


1 


Following the group’s lead, I generally refer to Choir! Choir! Choir! as c!c:c! 
throughout for brevity. Find them on their website (accessed January 13, 2018, 
www.choirchoirchoir.com); on their YouTube channel (accessed January 13, 
2018, www.youtube.com/user/CHOIRx3); and on SoundCloud (accessed Janu- 
ary 13, 2018, https://soundcloud.com/choir-choir-choir). 


2 Myers, “Choirstarters.” 


3 Baker, Blues, Ideology, 2. 


4 Like sound studies, “rhetorical studies” (and, more broadly, the “rhetorical 


tradition”) designates a large and not entirely coherent grouping of scholars 
and scholarship. This grouping includes at least two prominent disciplinary 
iterations in the academy: one often found in communication departments, 
where the scholarly focus tends to be on speech; and another in English 
departments, where writing and composition are the primary objects/activities 
of rhetorical inquiry (though this is a somewhat vapid simplification). My 
evocation of “rhetoric” is meant to name a common tradition that transcends 
disciplinary divisions. Ong himself studied and wrote of rhetoric and its 
histories outside of these paradigms and as a professor of literature. 

Street, “Critical Look at Ong,” 153. 

The Toronto School came about through Harold Innis’s and Marshall 
McLuhan’s application and expansion of the work and theories of Eric A. 
Havelock; all three men were associated with the University of Toronto. This 
work, which often “explored different implications of ancient Greek literacy 

to support [its] theoretical approach,” was generally focused on the notion 
that human communication is central to understanding the structures of both 
human culture and human minds (see Kerckhove, “McLuhan and the Toronto 
School,” 73). Central works include Innis’s Empire and Communications and 
McLuhan’s Understanding Media. Havelock’s Preface to Plato is also notable here 
due to its explicit focus on rhetoric. 


7 Ong, Orality and Literacy, 6, 76. 
3 Sterne, Audible Past, 16. 


11 
12 


See Derrida, Margins of Philosophy; Street, “Critical Look at Walter Ong.” 
Seeger, “Folkness of the Non-Folk,” 3. 

Sterne, Sound Studies Reader, 3. 

The theory and practice of media ecology came about through the work of Mc- 
Luhan, Neil Postman, Ong, and other members of the Toronto School. Central 
works include McLuhan’s Understanding Media and Postman’s well-known (and 
often critiqued) Amusing Ourselves to Death. Media ecology as a theory continues 
to have a strong academic presence in several anthologies. See, for example, 


RHETORICAL FOLKNESS : 77 


13 
14 
15 
16 
17 
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20 
21 
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23 
24 
25 
26 
27 


28 


29 
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31 


32 
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Crowley and Heyer’s Communication in History and the journal Explorations in 
Media Ecology, which is devoted to its history and development. 

Ong, Ramus, 107. 

Ong, Orality and Literacy, 11. 

Lambke, “Refining Secondary Orality,” 203. 

Ong, Orality and Literacy, 136, 137. 

Putnam, Bowling Alone, 216-17. 

See Graham, “Who’s Listening to SoundCloud?” 

See Clark, “St. Louis Central Library.” 

Ong, Rhetoric, Romance, and Technology, 284. 

In addition to their memories, humans also use their bodies as archives. See 
Taylor, Archive and Repertoire, and Schneider, Performing Remains. 

Ong was intrigued by the literary-turned-anthropological work of Milman 
Parry and his student Albert Lord. Parry is known for his pioneering work in 
Homeric oral poetry in which he demonstrates convincingly the formulary 
nature of the Iliad and Odyssey, which, though eventually written down and 
deemed “literature,” hailed from a much earlier oral tradition. Lord took 
Parry’s work into the former Yugoslavia, where he studied Yugoslav narrative 
poets who could not read and found the same kinds of formulaic devices at 
work there that Parry had found in Homer. See Ong, Orality and Literacy, 59. 
See Street, “Critical Look at Walter Ong.” 

Ong, Rhetoric, Romance, 285. 

Kennedy, Classical Rhetoric, 28. 

Ong, Rhetoric, Romance, 285. 

Ong points humorously to the then-contemporary duo Simon and Garfunkel, 
whose music, he argues, is rife with play on “worn rhetorical clichés.” The 
lyrics offer blatant informality within formal musical settings, “total irony,” 
and “total casualness”—all as playful innovations replacing tired formulaic 
commonplaces. Recall, for example, the comically mundane line “Citizens for 
Boysenberry Jam” from their 1968 song “Punky’s Dilemma.” 

Aristotle defines rhetoric as “the faculty of discovering in any particular case 
all of the available means of persuasion.” On Rhetoric 1.2.1. 

Freesound.org (accessed January 13, 2018, http://freesound.org/people/ 
AlienXXX/sounds/198827). 

The site whosampled.com (accessed January 13, 2018) helped me discover this 
information. According to the site’s search engine, “In the Air Tonight” has 
been sampled in forty-three hip-hop songs to date. 

For recent work that takes up sound’s relationship to rhetoric and the Western 
rhetorical tradition, see Walker’s Rhetoric and Poetics, Hawhee’s Bodily Arts, 
Johnstone’s Listening to the Logos, and Rickert’s Ambient Rhetoric. 

Ong, Orality and Literacy, 82-83. 
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THE PLEASURE (1S) PRINCIPLE 


Sounding Out! and the Digitizing of Community 


AARON TRAMMELL, JENNIFER LYNN STOEVER, 
AND LIANA SILVA 


Over the past five years, the Sounding Out! Editorial Collective has often heard 
our sound studies blog Sounding Out! referred to as a “labor of love” by our 
closest colleagues. Usually delivered in a tone that indicates both gratitude 
and pity—and often preceded by a sigh—the phrase “labor of love” indicates 
our willingness to “waste” precious uncompensated time from the tenure 
clock, dissertation timeline, and/or salaried workweek on a blog, with all of 
the self-indulgence that title entails.* Blogging is considered “scholarship 
lite” among some academic bloggers and tenure-and-promotion commit- 
tees, who often shunt it directly to the undervalued and much-maligned cat- 
egory of “service.”? Much like a dysfunctional relationship, our “love” of the 
field of sound studies (and Sounding Out!’s digital medium) has seemingly 
made us far too willing to donate some serious high-quality, low-value labor 
on its behalf. (digital) sound studies, we just can’t quit you. 

Suckers, right? 

Nope. As quiet as it is kept—and as challenging as shoehorning that 
labor into already jam-packed, demanding schedules has been—Sounding 
Out! has remained, first and foremost, a labor of pleasure. We not only love 


working on Sounding Out!, but it also feels good and it is fun (two affects rarely 
mentioned in connection with academic work, particularly in current work- 
ing conditions). Please do not tell our provosts, deans, chairs, advisors, and/ 
or bosses, because pleasurable labor remains labor nonetheless. 

While the massive amounts of fun we actually have while writing, 
building, curating, editing, representing, designing, tweeting, and so on 
may come as a surprise to Sounding Out! initiates, we’d like to think that our 
careful readers already sense our enjoyment; that, along with circulating 
information critical to an ever-increasing fold of sound studies scholars, 
we have successfully used the digital medium to communicate the very 
gratifying pleasure we take not only in hosting the “mothership” site and 
its social media constellation, but in the act of community building itself. In 
fact, we dare to contend that people who identify as members of the sound 
studies community also find the persistent, multimodal, participatory, and 
self-consciously accessible sound studies community Sounding Out! has cul- 
tivated since 2009 to be a very distinct pleasure. 

Despite the pleasure that Sounding Out! provokes in authors and readers 
alike, we nonetheless feel like outsiders in conversations about digital schol- 
arship in the digital humanities. Because many bloggers like us use a digital 
platform created by someone else, the question of whether blogging really 
constitutes “making”—a key but contested tenet of digital humanities—is 
a roiling debate. Of course, as this essay argues, we definitely think it does. 
Most recently, Debbie Chachra’s “Why Iam Not a Maker” argues against 
a strictly defined culture of coding-as-making in the digital humanities, 
maintaining that it is an oppressive “way of accruing to oneself the gendered 
capitalist benefits of being a person who makes products.” We’re stuck in 
the middle—not quite cool enough to hang with the computer dudes mak- 
ing robots and literature databases, yet somehow also complicit with the 
gnarly benefits of capitalist production. Our position as outsiders is far from 
unique; it carries with it the same racial and gendered biases that permeate 
all domestic spaces of society. Our work—editing, community building, and 
care—is the undercompensated affective and domestic work of the academy. 
As bloggers we both are and are not makers, and therefore we are outsiders. 

In this essay, the Sounding Out! Editorial Collective explores the central 
role of carefully tended affect in building a cohesive digital community. We 
believe that even in terms of intellectual connection, “feeling is first,” to 
quote e. e. cummings.? Therefore, we have peppered throughout this essay 
screenshots from an October 31, 2014, online editorial at Google Hangout as 
a performative insight into our affect—as individuals and as a collective— 


84 - TRAMMELL, STOEVER, AND SILVA 


Liana M. Silva 
if it weren't for SO! i don’t think folks would take me seriously as 
an intellectual, despite what i write and my interests. 


“2 


Aaron Trammell 
wow. 


Jennifer Stoever 
and that is why “gatekeeper” doesn’t describe us 


aol 


Aaron Trammell 

YES? 

We're a causeway 

A secret entrance 

An underground railroad. 
A hack 


Liana M. Silva 
i should specify that academics wouldn't take me seriously 


“2 


Aaron Trammell 
We're a hack. 


Jennifer Stoever 
and we are trying to show all the good old boy bullshit the door 


RE 


Aaron Trammell 
An exploit in the system 
YES! 


FIGURE 4.1 Discussion of our relationship to the social capital of Sounding Out! 


that functions as an ongoing methodological, sonic, and affective counter- 
narrative within the space of the formal academic essay.* Intentionally 
disruptive, these screenshots provide intimate insights into our editorial 
process so readers can feel the defensiveness, criticism, and pressure we 
face on a constant basis; they respond, with boldness and candor, to the 
feedback we have all encountered throughout our careers about the worthi- 
ness of Sounding Out! and the blog format. Though so! has become a staple 
in the sound studies community, we can’t help but feel like outsiders look- 
ing in to conversations in the digital humanities, which are often centered 
around the grant-winning merit of boutique digital platforms as opposed to 
the populous, intimate, and perhaps now antiquated form of web-logging 
(blogging). But we also want to invite readers new to so! to understand how 
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together we weave a protective sonic web of humor, backtalk, and so-called 
colloquial language that not only assuages that pressure but also provides 
an ongoing source of freedom and pleasure, what Sebastian Ferrada calls 
“an audible badge, a marker of experience rather than a punchline” that con- 
structs “an alternative aesthetic” through speech, accent, and tone. We hope 
that the selected screenshots provide necessary push-back to the content 
they interrupt while better contextualizing the love, labor, and passion that 
have always pushed our humble blog forward. 

Combining our frank, spirited, nuts-and-bolts discussions of Sounding 
Out!’s editorial decisions and history, then, with a theorization of digital 
community and a qualitative analysis of an so! community-member survey, 
we argue that Sounding Out! has only established itself as a trusted and note- 
worthy venue for sound studies scholarship through an artisan-like approach 
to community building that fosters an important (yet often missing) feeling 
of community within and without brick-and-mortar institutions. The digital 
medium in particular facilitates many of the microinterventions Sounding 
Out! stages in the areas of editing, social media engagement, branding, and 
active readership. 


Where It Started 


We founded Sounding Out! The Sound Studies Blog in 2009 as a way for three 
academics interested in talking about sound to stay intellectually engaged 
while physically separated. Little did we know when we first created our 
WordPress site that seven years later, our project would become, as Jona- 
than Sterne describes in the survey conducted for this essay, “an interdisci- 
plinary resource for a massive interdisciplinary sound studies community 
. .. More important than any journal in terms of disseminating ideas and 
scholarship.” Although the respect and trust we have earned from our col- 
leagues has always meant more than official seals of approval, those seals do 
represent our rapid growth. In 2013 Sounding Out! received an ISSN number 
(2333-0309) from the Library of Congress and in 2014 became one of only ten 
scholarly sites whose articles the Modern Language Association indexed in 
its International Bibliography.’ 

In 2007-8 (the year the Sounding Out! team came together like Voltron 
in Binghamton, New York) sound studies as a field remained fairly diffuse 
and underground. Interest in sound and audio culture seemed constantly 
emerging and never fully emergent, arising as it did from unique concerns 
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Jennifer Stoever 

so here’s my thing--l do like a decentered sound studies from 
the position of scholarship. being a “side piece” has produced 
some great work because of the tension between disciplinary 
location and interdisciplinary inquiry.. but its lonely in the day to 
day. and even though it seems everywhere right now, how to 
successfully reproduce another generation of scholars if there 
are not dedicated grants, only scattered organizations, no 
departments/programs and most importantly, no jobs. what 
happens after this hipness wave passes? also, labor-wise, does 
being a side hustle just extract more labor from the university's 
side? 


Ca 


Liana M. Silva 
yes, those are all very valid points. i like where you’re going 
with this. 


Jennifer Stoever 
is sound studies just value added? 


Aaron Trammell 
or worse? 


Jennifer Stoever 
uh oh 


GEG BS 


Liana M. Silva 
also, how many sound studies scholars can afford to do sound 
studies, right? 


“= 


Aaron Trammell 
A ccontition that necessitates vale added 


Jennifer Stoever 
are we enablers 
#thedarksideofSO 


Ea E 


FIGURE 4.2 Discussing how Sounding Out!’s creation both breaks through the lonely 
echo chamber faced by most sound studies scholars and creates new—and largely 
uncompensated—“value” for the neoliberal educational complex. 


at different moments in a wide spectrum of academic disciplines—in par- 
ticular, acoustic ecology, cinema and television, history, anthropology, 
literature, art history, and ethnomusicology—as well as in thoroughly inter- 
disciplinary fields such as African American studies, American studies, sci- 
ence and technology studies, radio studies, and urban studies. In what Jim 
Drobnik declared a “sonic turn,” a buzz began to circulate around a small 
canon of recognizable names who published exciting but disparate-seeming 
monographs.‘ Through Google searches, word of mouth, third-generation 
photocopies of syllabi, qualifying exam lists, the occasional conference 
panel, groundbreaking seminars (such as Josh Kun’s at the University of Cal- 
ifornia, Riverside, in 2000 and Karen Pinkus’s at the University of Southern 
California in spring 2004), patient, repeated answers to the “What is sound 
studies?” question from determined graduate students, and dissertations 
such as Jennifer’s in 2007, “sound studies” stubbornly accreted a method- 
ological center.’ 

When Jennifer arrived at Binghamton University as an assistant profes- 
sor in the fall of 2007, she felt lonely and disconnected from her tight-knit 
University of Southern California American Studies community and usc’s 
dynamic sound studies nucleus, then composed of Fred Moten, Josh Kun, 
Bruce Smith, and Joanna Demers. The experience of isolation remains all 
too familiar for many sound studies scholars even now. There are few, ifany, 
academic job listings for “sound studies” in the United States—and even 
though positions naming sound studies as a field of interest are becoming 
more common, they remain in the realm of “a handful.” Most academic 
researchers who work in sound studies are technically hired to do “some- 
thing else,” and interest in sound is presented as a unique methodological 
take and/or a quirky bonus field. In our current corporate academic speak, 
it “adds value” to an already solid research profile—which means that, in- 
stitutionally, sound studies graduate students and professors largely find 
themselves alone in an echo chamber. 

To remedy the sense of stagnation that comes so quickly on the heels 
of isolation, Jennifer and Aaron began constructing a group called the 
Binghamton University Sound Studies Collective (BU ssc) as a face-to-face 
interdisciplinary group to suss out colleagues with even remotely similar 
interests. At the very least group members had the desire to discuss the 
exciting new questions surrounding the cultural meaning of sound and 
listening, seemingly vibrating from everywhere at once. While the group 
had one well-attended first meeting, a sweet logo, and one hell of a speaker 
series in 2008-9 (Martin Daughtry, Fred Moten, Frances Aparicio, and Trevor 
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FIGURE 4.3 The official logo of the Binghamton University Sound Studies 
Collective, designed by Conrad Weykamp, 2011. 


FIGURE 4.4 A page from Jennifer Stoever’s 2009 daybook, showing our initial 
planning meeting. We’ve been a “blog” from day one. imace By JS. 


Pinch), the group dissipated fairly quickly into a lonely listserv and a hard- 
core handful of awesome grad students who were interested but brand new 
to the field. 

At the time, BU lacked a campus culture and interdisciplinary infrastruc- 
ture and, apparently, there weren’t many interested colleagues. Although 
somewhat daunted—who wouldn’t want to talk about sound while cashing 
in on free food?—Jennifer and the hardest core of them all, Lianaand Aaron, 
decided to reach beyond Bv’s highly disciplinary walls and create a virtual 
community to sustain ourselves as the band broke up. While Jennifer re- 
mained at Binghamton, Aaron finished his MA and left for a Rutgers PhD 
program in media studies; Liana took off to dissertate in Kansas City. But 
like a cD stuck on repeat, we needed to keep spinning our ideas around 
to each other. Often. We also hoped that if we put out a virtual bat signal 
via a blog, we could bring in the folks we were meeting at conferences and 
reading and writing about via stray journal articles. And they might tell two 
friends. And so on, and so on. And so on. 


The Premise 


By design, therefore, we founded Sounding Out! as an intervention regarding 
the notion of affective community as format, logistics, and politics in the 
field of sound studies. When we say “community,” we borrow from Ray- 
mond Williams’s definition: it reflects “the quality of holding something in 
common .. . a sense of common identity and characteristics.” Interestingly, 
Williams points out that after the nineteenth century, “community was the 
word normally chosen for experiments in an alternative kind of group liv- 
ing.” Considering that Sounding Out! is a space for sound studies aficionados 
invested in the field in some way—and who are seeking an alternative from 
silo-bound campus culture—Williams’s definition of community as group 
experiment is fitting. 

In addition to Williams’s definition, we take inspiration from Jack Bra- 
tich’s reworking of the term “digital” in “digital community.” The predom- 
inant understanding of a digital community remains focused on emerging 
modes of interaction enabled by innovations in computing technology: 
content management software, Wikis, social media, open-source software, 
and even MOOCs have been both celebrated and critiqued as new spaces of 
discourse with the potential to shake things up a bit. We find this definition 
reductive in its scope, however, as it instantiates the digital as a mode of 
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interaction informed primarily by the materiality of the platform that hosts 
the interaction. In other words, it is digital because its mode of publication 
is digital. 

But the digital, as Bratich argues, invokes the former definition alongside 
a second, older connotation: digits as fingers. This understanding of the 
digital foregrounds moments of craft production and invisible infrastruc- 
tural labor, as opposed to a definition that focuses instead on the ways 
being digital often invokes a discussion of platform affordances.° When we 
founded Sounding Out!, the blog as a format was swiftly becoming an anach- 
ronism of the aughts. We began at a time when the blog no longer was being 
taken seriously by the mass media—treated instead as a mechanism for in- 
stant celebrity or a narcissistic hobby. Despite (or perhaps because of) this, 
we encountered an intuitive, reliable, and affordable content management 
system that WordPress had spent the past decade developing (and has spent 
the time since simplifying to the point ofincomprehensibility). So we began 
the blog with the ethic of a craft circle, trading tips with one another as we 
learned the WordPress platform. This ethic even seeped into our editorial 
practices—in which we curate, edit, array, and host with a care often taken 
only by small, artisanal presses—and circulated through the social media 
networks of like-minded crafters interested in continuing the dialogue. 
Jenny Sundén calls this a “transdigital affect,” or “a type of corporeal rela- 
tionality that arises in contemporary passionate encounters with the analog 
made possible by, or realized through, the digital.”*° Sounding Out! uses a 
digital platform to respond to the traditionalist model of the humanities 
the way that punk zines allowed radical new voices into the sphere of rock 
journalism. We are digital activism. 

First and foremost, our move to combine craft production with a group 
experiment in digital community building came from a desire to push the 
rhetorical boundaries of sound studies and the sensory nature of “writing” 
itself. We considered, like Mark Sample, “Why must writing, especially writ- 
ing that captures critical thinking, be composed of words? Why not images? 
Why not sound? Why not objects? The word text, after all, derives from the 
Latin textus, meaning ‘that which is woven,’ strands of different material 
intertwined together.”’! The epistemologies through which we apprehend 
our knowledge affect the modes in which we approach and understand it. 
Simply put, a sound translated into text is qualitatively different from a live 
experience of it, and this commonsense fact deserved more than just a nod 
within our tradition of scholarship. 

Working in a “born-digital” format enabled us to think critically about 
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how to present what Marcus Boon calls “sonic realness” in sound studies 
scholarship and to do it in public, where both our successes and our short- 
comings could enable others’ work.*? For example, in addition to embedding 
sound within posts—with varying degrees of integration—Sounding Out!’s 
monthly podcast has been an important speculative solution to the problem 
of scholarship through sound. By offering a monthly broadcast with mini- 
mal written notes, we have hoped to provoke sound studies scholarship to 
listen more closely to itself. The podcast space is deliberately unstructured, 
and broadcasts vary from radio style exposé to interview to digital sound art 
installation. By remaining freeform, we hope to represent the diverse array 
of modalities interdisciplinary engagement takes. We serve our constituents 
by allowing our podcasts to take the forms most necessitated by members 
of the community. 

In addition to the logistics of rethinking the nature of work in sound 
studies, there has also been an infrastructural need for a communications 
network. Sound studies in the United States has remained dispersed within 
the disciplines, even after the European Sound Studies Association formed 
in 2012. Until 2013 there were no large-scale U.S.-based academic “sound 
studies” events, although chartered groups represent and vivify the field in 
several major organizations.’? Without formal institutionalization in the 
United States, the field has remained productively critical and refreshingly 
rhizomic, butits lack of formality has its drawbacks; the exciting interstices 
of our field remain “dark matter,” comprising the bulk of “sound studies” 
but remaining hidden save for the occasional special-issue spectacular. 
(Thank you, Social Text [2010]! Performance Research [2010]! American Quarterly 
[2011]! differences [2011]! Radical History Review [2015]!)** And although the 
infrastructural work that occurs behind the scenes at conferences and 
departments across academia is valiant, to say the least, we saw that the 
field needed a forward-thinking forum that allowed for the expression of its 
radical sonic epistemologies and interdisciplinary experimentation. 

Sounding Out! makes the “interdisciplinary” aspect of sound studies 
more audible, consistent, and apparent. It highlights existing affinities and 
makes new contacts between formal groups and individuals by circulating 
calls for papers on Facebook and Twitter, posting conference previews that 
address the “state of the field” and cull panels of interest, cross-posting and 
cosponsoring topical series with groups such as IASPM and Antenna, hosting 
a monthly “Comment Klatsch” open forum (2013-14), and adding media 
scholar and longtime supporter Neil Verma to the team as SCMS/ASA spe- 
cial editor in 2014. (Neil coordinated guest editors and writers from these 
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organizations.) Very deliberately and through multiple means, Sounding Out! 
spins a center of gravity for sound studies, enabling a sense of community 
effort, pleasure, and enthusiasm to fuel the push to new areas. Moreover, as 
we connect with digital humanities scholars via Twitter and HASTAC, we see 
others asking similar questions about media, format, and research “tools.” 
Sounding Out! articulates a #dhsound relationship, even when as “bloggers” 
we often had felt left out of the DH conversation. 


The Politics That Guide Us 


In terms of politics, Sounding Out! pushes the field through its editorial fo- 
cus and demography. Every post hosted by Sounding Out! provokes conver- 
sation about social difference and power, fundamental topics lost or out- 
right evaded as sound studies’ newest efflorescence gained momentum in 
the 2oros. Even as late as January 2015, a sound studies colleague sent out 
a Facebook message that appeared in Jennifer and Aaron’s feeds describ- 
ing an application received for a new sound studies book series in which 
the editorial board and prospective authors were all males whose proposed 
topics blithely ignored the multiethnic and transnational issues at stake in 
the field.* At Sounding Out! we proactively think about gender, about race, 
about class, and about sexuality. By taking an unequivocal stance that poli- 
tics matter both within and without the field, Sounding Out! fosters a material 
sense for its readers and writers of being listened to and having a voice, en- 
acting a self-aware and critical public conversation that remains grounded 
in sound studies’ social impact and that continually centralizes the work 
of scholars who might otherwise be marginalized, even in the generally 
friendly atmosphere of an emergent field. 

Moreover, we don’t just talk the politics, we show and prove our commit- 
ment to amplify different voices and to reach out to a wider readership. We 
polish our writing to make it readable: we aim to attract interest rather than 
assuming it (as much scholarly writing does, to its detriment) and aim for 
an accessible tone that opens up the rigor of our field beyond the academy. 
We often describe Sounding Out! as the site where our nonacademic friends, 
family, and colleagues can finally “get” what we have been spending years 
of our lives studying and see why it matters. At the same time, the Sounding 
Out! Editorial Collective actively recruits an ever-expanding team of regular 
and guest writers who more accurately represent the demographics of sound 
studies. 
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Jennifer Stoever 

and | really do think we have tapped into a huge vein of work on 
power in sound studies that was not on the Sound Studies 
agenda (other than a few folks). 


Cà 


Aaron Trammell 
Yeah, I think so, too. 


Jennifer Stoever 

my grad class was talking about race and sound yesterday like 
it was no thing and it made me happy but also like YOU DON’T 
EVEN KNOW. 


Ay 


Aaron Trammell 
Yep! 


Jennifer Stoever 
and unless we stay vigilant about power, it easily slips out of 
conversation 


Liana M. Silva 
YUP it does... 


Aaron Trammell 
Agree. 


Jennifer Stoever 

SO! is always listening 

in that sense | see us in the role of an amplifier 
if volume is power. . . 

we turnt up what we wanted everyone to hear 


Gat Ps tal: 


Liana M. Silva 
#turndownforwhat 


Jennifer Stoever 
and muted the other stuff 
at least where and when we could 


Aaron Trammell 

Totally! 

| really like the always listening metaphor 
Not as a gatekeeper. 

But as a friend. 


GA 


FIGURE 4.5 Discussing the need to “stay vigilant about power” and race and how 
we see Sounding Out! as an amplifier, a listener, and “a friend.” 


When Sounding Out! plots our publishing calendar, we think about aca- 
demics and nonacademics. About senior and junior scholars. About gradu- 
ate students. About women. About people of color. About people at various 
points along the spectrums of sexuality and gender. About specialists and 
nonspecialists. About alt-acs and independent scholars. We actively seek 
artists, sound professionals, curators, musicians, DJs, game designers as 
practitioners, experts, and theorists. While we cannot promise perfection, 
we do promise perpetual vigilance; our open submission policy, comments 
section, and social media platforms enable our commitment and allow 
our readers to assist in this process. We host diverse conversations not as a 
vague gesture toward inclusion or a specious invitation for “others” to join 
a preexisting conversation, but rather as a blueprint to construct a lasting, 
interactive community that values a variety of epistemologies, welcomes 
diverse and multimodal forms of rhetorical address, and involves and con- 
nects people rather than compiles an abstract, empty referent. While the 
online format enables Sounding Out! an unprecedented reach and a much 
more democratized distribution network, our Sounding Out! community 
thrives through a digital rendering ofan analog sense of affect, as our survey 
results reveal in the subsequent sections. 


Blogging and/as Community and Platform 


“Blog” is a key term for the editorial team. It is literally embedded in the URL 
of every webpage of the site, sure, but that embeddedness is emblematic of 
how “blog” is more than just a noun for us. Blog is ethos, rhetoric, and form. 

For us the term “blog” best captures the productive tension Sounding 
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Out! creates between “journal” and “magazine,” “seriousness” and “play,” 
“academic” and “public,” with the added layer of sound and visual media 
capabilities a digital platform enables. Our commitment to the term is both 
practical—“soundstudies.com” was already taken, so “soundstudiesblog 
.com” seemed like the next best address—and tactical, freeing us to ex- 
periment in ways that might “tarnish” a journal’s reputation or frustrate a 
magazine’s readership. Furthermore, the close association of “blog” with 
Internet 2.0 immediately signaled different expectations to our writers and 
readers—namely that there will actually be sound embedded in the writing 
in a meaningful way." For many of our writers, just knowing Sounding Out! 
offers them the capability to embed sound significantly shifted how they 
approached their work.” Although many of our posts appear at first glance 
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Liana M. Silva 
and i’d be interested in exploring more the concept of the blog, 
to see how that fits into what we’re saying/experiencing. 


Jennifer Stoever 

i think we cling to the word blog because to us it signifies a kind 
of freedom and flexibility to reinvent and evolve that the other 
terms don’t seem to. 

what the hell is an “online magazine” anyway? 

you know? 


Aaron Trammell 
Yeah. 


Liana M. Silva 
it would be neat to situate SO as blog in a broader conversation 
about blogs. 


Aaron Trammell 
I’m more practical with it. 
We're literally stuck with it. 


Jennifer Stoever 
true 


Aaron Trammell 
It's part of our identity. 


Jennifer Stoever 
it is in our name 


Aaron Trammell 

Like it or not 

So lets not shun ourselves for it 
Lets embrace it and love it. 


FIGURE 4.6 Our discussion regarding concerns over the term “blog.” 


to be written posts that include sounds, our editorial experiences with writ- 
ers and their responses to our survey (discussed below) reveal a much more 
complicated process at work. Using a multisensory digital genre enables 
folks who are writing for online platforms to “think with” sound and image 
in new ways, from the very inception of an idea, an advance that has signifi- 
cantly shifted the writing itself. Furthermore, the flexibility of the medium 
(e.g., add a widget on the sidebar, review the list of categories for the posts, 
embed an audio file in a post, start a real-time discussion in the comments) 
allows us to constantly reinvent how writing about sound studies looks and 
sounds. A tour of our readily accessible back catalog will show how much 
we’ve grown and how our editorial sensibilities have developed, particularly 
in using the visual as a sonic medium online. The categories in themselves 
allow us to index a field that is no longer burgeoning but still changing and 
responding to current events. 

Over the years we as a team have debated whether to move away from a 
blog format, especially as we considered how changing our nomenclature to 
“journal” would give us a certain legitimacy with academic audiences outside 
of our readers and writers. Shifting the title to “journal,” however, short- 
changes the many others who are doing great—intimate and immediate— 
work with blogs. We lose in spirit when we identify as something we are not. 
So we revisited our charge and decided that we are a blog. We didn’t need to 
be a journal: there are now journals publishing work in sound studies, and 
we recognize that some scholarship benefits from the slow approach of a 
print journal. We do not see blog in opposition to journal; all three of us 
regularly read, publish, and cite print scholarship. Sounding Out!, however, 
provides a new space for a different kind of scholarship, because it 


is improvisational, 
responds to current events, and 


mediates between academic scholarship and nonacademic responses 
and the praxes of both. 


More importantly, Sounding Out! is not just a different format for academic 
scholarship; it forces readers and writers to consider the way the work is 
produced. As blog editors, we work closely with writers about their writ- 
ing, we communicate constantly with them regarding revisions, we promote 
tirelessly their work via our social media profiles, and we ultimately see the 
creation of the multimedia blog post as a collaborative effort. We do not 
leave our writers alone. We are there via email, tweet, or even in conversa- 
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tions happening in the comments to a draft. The blog, in essence, is not just 
a space online to post work; it also becomes a work ethic where we develop 
and produce each other’s work. We write, we comment, we post, we listen. 

It is also important to point out that hosting a blog requires a kind of 
work that journals often take for granted: we must vigilantly tend to our 
presence in the World Wide Web. Every post is carefully tagged not just for 
the sake of our readers but also for the sake of connecting Sounding Out! to 
online searches around the world (and permanently archiving so”s partici- 
pants). If the categories are an interior indexing mechanism (like a table of 
contents), tags are echoes bouncing back into the internet. (They literally 
help to index us for search engines.) This careful attention to categorization 
also helps us stand out in search results. The essential work of search-engine 
optimization—categorization, headline building, index management, and 
layout (the mundane tasks of web maintenance)—is seldom recognized as 
valuable labor by the academy. We work hard to make sure that Sounding Out! 
blog entries appear as relevant search results for anyone looking for insight- 
ful reading on sound. These tasks exemplify the best practices in digital 
publishing and make clear some of the many ways that digital publications 
can be evaluated. 

And this is where form begins to trump content when it comes to the la- 
bel “blog.” While much academic energy expends itself in debating whether 
a blog “counts” as much as print scholarship, scholars and administrators 
alike pay very little attention to the structure and function ofa blog as digital 
craft of a radically new order.* Precisely because of its radical affordances, 
the debate over “public scholarship” somewhat belittles the participation 
enabled by the blog form: How else could two graduate students of color and 
a first-generation, working-class junior academic (two women, one man) 
establish a publication that has made such deep imprints in the field? The 
blog threatens established hierarchies and allows for new voices to slip in 
and expand discourses that previously have been hermetically sealed. The 
blog can do this because it relies on affective affinities between its editors, 
writers, and readers, as opposed to the economic and patriarchal affinities 
of the print journal, the established hierarchies of rank and review in the 
academy. 

We, as editors of Sounding Out!, consciously choose “cred” over “credit,” 
particularly when working with our authors. The long hours spent editing 
(and laying out) each post are uncredited, and many colleagues assume 
the vetting to be less rigorous than the work of peer review for a journal. 
No course releases are provided for our work; no grants have ever been 
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af Jennifer Stoever 
i | still like the idea of a platform 
' in the old sense of the word, not just digital 


F Liana M. Silva 
f that’s precisely it: we provide a platform. 


laf Jennifer Stoever 
į we built our own platform from which to speak, which is difficult 


to do. 
but we also recognized that listening is just as important as 
speaking--and we cultivated a community of listeners 


i + Aaron Trammell 
i | love that! 


FIGURE 4.7 Our discussion of what the term “platform” means to us as an 
editorial team. 


awarded to us; and Sounding Out! was given only a couple of sentences, un- 
der “service,” in Jennifer’s official tenure case. This is not to say, however, 
that we haven’t accrued other important benefits from our labor, such as 
much higher visibility, more invitations to editorial boards and collectives, 
and wider national and international networks than are available to many 
early-career scholars and alt-academics. Most meaningful, however, to the 
three of us is the strong sense of “cred” we have steadily earned within our 
community by maintaining pleasurable professionalism and a superlative 
internal standard. Those who become part of our community come to rely 
on us, and in turn they do what they can to spread the word. 

While the “always-on” feel, conversational tone, and time-sensitive 
publication of Sounding Out! certainly have helped build this actualized 
community, we as editors have built it link by link by link.” Linking is not 
terribly sexy labor—both web users and university administrators take it 
for granted—but to us it feels like breathing, an almost unconscious prac- 
tice necessary to animate the entire structure. For example, our decision 
to embed links rather than use footnotes was tactical rather than stylistic 
(even ifit runs counter to the style guides we memorized as undergraduates), 
enabling us to further embed ourselves within conversations about sound 
occurring on the web. Links perform the function of citations, but they also 
shape search-engine results; according to Tim O’Reilly, the more “prolific 
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and timely” a blog’s links (and “self-referential” within a community), the 
more the process of “bloggers paying attention to other bloggers magnifies 
their visibility and power.””° And sure enough, after seven years of tireless 
linking between blogs, journals, universities, and social media sites (over 
17,400 tweets as of July 2016!), if you enter the search term “sound studies” 
in Google (as we asked our survey respondents to do), Sounding Out! comes 
up in the first five entries, often in the top three, just under the Wikipedia 
entry (which lists us) and Sterne’s canon-making The Sound Studies Reader as 
key resources for the field. Importantly, our location means that just about 
anyone looking up sound studies—from undergrad to sound professional 
to grad student to colleague to grandparent—will come across so! and 
its interventions regarding sound, social difference, and power early on, 
insuring such inquiry will become—and remain—the heart of the field. 
Our hard-fought Google rankings represent something far more important 
than winning results of a popularity contest or nice evidence of “reach” for 
university administrators perusing our tenure files; it reveals the literal and 
figurative “platform” we have worked to build for ourselves and our commu- 
nity. Again, we’ve developed “cred” in lieu of “credit.” 

When we met in a humid apartment in upstate New York to plot a sound 
studies blog back in 2009, one of our key goals was to provide indelible 
visibility to the top-notch contributions we knew were being made to 
sound studies by scholars of color, graduate students, junior scholars, and 
other disempowered groups in academia, so that their role in building this 
growing field could not be erased, ignored, silenced, hijacked, buried, or 
claimed by others better positioned by social and institutional privilege and 
its attendant cultural capital to gain conference spots and find publishers 
for their work. There is solidarity in the affects produced by giving voice, 
making visible, and—above all else—listening. As Sundén argues, “The 
ways in which we imagine and feel for technologies matter,” so we decided 
to build our own site and to do so in a way that celebrates the people and the 
scholarship perpetually at the fringes of most fields, but especially those 
involving technology and music.”* Sounding Out!’s consistent publication 
and voracious linking structure created the platform; we then combined 
well-written, cutting-edge, quality scholarship with participatory social 
media; targeted blogrolling; in-person conference marketing and social 
events; active recruitment and developmental editing; and colleagues’ 
support through retweets, shares, pings, and traditional citation to create 
an ever-growing community of listeners surrounding it. The blog listens, it 
breathes, and it provides a center to anchor the precarious labor of fringe 
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scholars who might otherwise be swept away in the market-driven and op- 
portunistic frontier of the digital rhizome. Industry practitioners, graduate 
students, and independent scholars have the most to lose by blogging, but 
they also have the most to gain when it is done right. We strive to support 
these vulnerable scholars in any way we can. 


Survey 


Because our goal has always been to foster a greater degree of affinity around 
the topic of sound studies, we felt an essay of this kind would be incomplete 
without affording some insight into how sors primary participants under- 
stand this sense of community (rather than just speculating or assuming 
our theories always rang true). We wanted to listen to the participants in 
our community so that we best represent ourselves as the collective, posse, 
and crew we are. Our blog would not be as successful—or as fun—as it is 
without the labor of the writers who contribute week after week. To bet- 
ter understand how Sounding Out! serves its contributing network of digital 
scholars and activists, we conducted a survey that queried for qualitative 
data regarding the publication’s reputation, circulation, reception, and ed- 
itorial process. We chose not to administer our survey anonymously due to 
the level of detail we requested—essentially, we would have been able to 
identify respondents anyway—and we sent it to every guest writer who has 
written for Sounding Out! since the site’s establishment in 2009. In total, we 
received twenty-four responses from a total pool of one hundred partici- 
pants. We administered three follow-up questions to these twenty-four re- 
spondents in late January 2015 and received twelve responses. 

We coded the results using a grounded theory methodology that allowed 
our data to speak for itself and reveal a set of relevant categories.” During 
the coding process, we compared results and selected emerging themes 
and categories as well as identifying several interesting (yet understated) 
categories to unpack in this essay. Our aim here is to highlight a sense of 
consensus about Sounding Out! as well as to provide some insight into how 
this consensus has been challenged, for instance in terms of the editorial 
process or our place in the digital humanities universe. 

We also chose not to make our survey anonymous because we felt that 
personality and profession would play heavily into the ways in which our 
respondents would consider the rife political nature of these questions. As 
such, we wanted to be able to weigh and acknowledge how responses were 


THE PLEASURE (IS) PRINCIPLE -+ 101 


relative to a particular professional positionality. We also wanted to better 
understand and credit the labor of our contributors. We posed the following 
eight questions (or prompts) to our survey respondents: 


1 How would you describe Sounding Out!? How do you see it in 
relationship to the digital humanities community? 


2 Describe your personal involvement in Sounding Out! 
3 How was your experience of the editorial process? 


4 Please describe your experiences with any or all of our social media 
platforms (Facebook, Twitter, Tumblr). 


5 Has Sounding Out! aided and abetted your scholarship, art, sound 
work, and/or any other capacity? If so, please tell us how. 


6 What has been the best part of being involved in Sounding Out! over 
the years? 


7 What do you think that Sounding Out! could do better? 


3 Any final thoughts you’d like to share with us? 
We then asked all respondents these two follow-up questions: 


1 When you search for “sound studies” in Google, where is Sounding 
Out! in your results? 


2 Very basically and honestly, why did you publish your work on 
Sounding Out!? 


The respondents had the opportunity to respond online between April and 
May 2014, just in time for the blog’s fifth anniversary, and to follow up in 
January 2015. 

In terms of broad trends, respondents commented about our editorial 
acumen, pointing out how rigorous the editing process is and how reward- 
ing it is at the end. Our respondents saw Sounding Out! as a resource, a hub, 
and a platform, but very few saw it as a “blog,” judging by their avoidance of 
the word itself. Many also follow sors Twitter feed, which they enjoyed both 
for its informative and for its personable qualities. Respondents used words 
that suggested they feel an affective connection to Sounding Out! and the com- 
munity it fosters: we noted the recurrence of words like “helpful,” “connect,” 
“accessible,” and “isolation.” Survey respondents also noted that they came 
to the blog to keep up with the field and that, in various ways, it enabled 
them to feel part of a wider community. In the following subsections we 
discuss the results in detail, focusing on how respondents felt a connection 
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to sound studies, understood our editorial process as peer making (not just 
peer reviewing), defined themselves as writers AND readers, and actively 
engaged with sors microinterventions on Twitter. 


Connections with the Discipline 


Although we think of the website, our bloggers, and our readers as the so! 
community, we also see ourselves as part of bigger disciplinary communi- 
ties, part of sound studies, and part of digital humanities. Because we do 
not affiliate with an institutional structure to house our work—and have 
received no external funding—we rely on connecting with other scholars to 
feel like part ofan academic network. Our bloggers agree that they feel con- 
nections with those disciplines and with each other through Sounding Out! 
In the survey, several respondents across ranks mention how they see 
Sounding Out! as a way to stay involved with sound studies. For example, 
Meghan Drury (a graduate student when she took the survey) mentions that 
“Sounding Out! provides an important digital resource for sound scholars in 
the U.S. and worldwide. . . the posts on Sounding Out! stimulate my intellec- 
tual development and encourage me to think about sound scholarship in 
new ways.” For Drury, the blog provides not just reading material but also 
professional development within the field. Associate Professor Priscilla Peña 
Ovalle, who describes herselfas a scholar in a field “adjacent” to sound stud- 
ies, states that writing for and reading the blog become for her a way to stay 
in touch with the field. Kariann Goldschmitt, now an assistant professor, 
shares that “the network of thinkers involved in the site is really exciting. 
Whenever I run into people at conferences, we have a deeper understand- 
ing of each other’s work. That’s incredibly rewarding.” Reading the blog 
becomes a way to perform scholarly community, to understand the work 
of other sound studies scholars by reading their work on the site and some- 
times engaging them in conversation via social media or email. Sounding 
Out!, in this case, is a meeting ground for ideas and scholars. And bringing 
scholars together to talk about anything is like herding cats, #humblebrag. 
Regarding digital humanities, some of our respondents were unsure 
about their understanding of the term “digital humanities”—or if Sounding 
Out! qualifies based on a rubric of “big data”—but others believed that the 
blog exemplifies what a project-based digital humanities community can be. 
For example, recent PhD and now assistant professor Steph Ceraso points 
out, “I think that the Sounding Out! community is a wonderful example of 
what the DH community strives to be: a welcoming space for new ideas and 
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diverse voices, a community that encourages collaboration, an open com- 
munity that freely creates, shares, and builds upon ideas, and a community 
that is always respectful and generous to its members.” She stays away from 
references to the digital platform and instead focuses on the possibilities of 
a space that brings together a diverse group of scholars and practitioners, 
a situation particularly meaningful for her as, at one time, the only student 
in her department dissertating on sound studies. Meanwhile, professor 
and curator of the Rose Goldsen Archive of New Media Art Timothy Murray 
connects Sounding Out! with DH conversations about “hack vs yack”: “Sound- 
ing Out! is a forceful, performative blog that links makers, thinkers, and 
listeners in the critical involvement of studying sound.” Overall, the survey 
responses show that Sounding Out! offers an understanding of community 
aligned with the social connotations of the digital, but one whose meaning- 
fulness and pleasure are enhanced through the relationships Sounding Out! 
enables and strengthens IRL (in real life). 


Editorial Process 


Commonsense undertones carried by the word “blog” can betray the edi- 
torial labor that goes into each post, which is connected to how editing is 
perceived in academia overall: as begrudging necessity rather than pleasur- 
able community praxis. In other words, editing is considered service, an 
undervalued category of scholarly work. Ever-dizzying work schedules and 
publication expectations in the humanities and social sciences have made 
editing a far less collegial practice, one performed quickly, quietly, and with 
less-than-desired amounts of interchange. The traditional blind peer review 
model, particularly when combined with the work speed-up, can lead to a 
one-sided exchange of punitive comments rather than productive feedback; 
after all, the same busy colleagues with little time to form a writing group 
are the same folks tapped, often unexpectedly, to perform uncompensated 
ad hoc editing for professional journals. More often than not the cloak of 
anonymity, proposed as a meritocratic guarantee of objectivity and quality, 
masks curtness and flat-out rudeness as reviewers brusquely pass judgment 
rather than leaving comments intended to develop the piece. The current 
traditional editorial model leaves writers bereft of mentorship or critical di- 
alogue about their work at perhaps its most crucial point; even if a writer 
discusses readers’ feedback with their editors, it is mainly in terms of “what 
needs to be done to satisfy the readers” to get the piece published. There is 
rarely, if ever, another read beyond copyediting. Not merely a missed oppor- 
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tunity for productive exchange, traditional blind peer review (as it is cur- 
rently practiced) actively fosters isolation. 

Because we consider the community-building function of so! as its pri- 
mary purpose, we prefer the verb “host” to describe how we disseminate 
scholarship, rarely using the word “publish”—even if the button we click 
on WordPress says exactly that. Our respondents, too, emphasized the role 
of the blog as a host for sound studies scholarship. For example, Assistant 
Professor Tom McEnaney mentions that “Sounding Out! is the preeminent 
place to go—in print, or online—for innovative work in sound studies.” 
His comment draws attention to the blog as a location where readers come 
to find new work in the discipline. Goldschmitt states, “Sounding Out! is an 
important forum for discussion and nascent scholarship.” Professor Karl 
Swinehart adds, “Sounding Out! is an important venue where scholarly work 
within sound studies is presented in a multimodal format and in an idiom 
that is accessible across disciplines.” The references to the blog as “venue,” 
“forum,” or other site to encounter work in sound studies draw attention 
to how the blog provides writers with a platform to share their work while 
connecting them to readers eager to hear what they are working on. 

For Sounding Out! to host exciting writing and new research, as editors 
we work as cohosts throughout the editorial process. Combining Kathleen 
Fitzpatrick’s “peer-to-peer review” model, in which editors and writers 
are known to each other, with the praxis of developmental editing more 
common to popular print media and trade presses, Sounding Out! pursues 
editing’s community-building possibilities through practices that build 
trust and accountability through communication.” As McEnaney states, 
“As a writer, I found the editorial process intensely engaged, and incredibly 
helpful.” In addition to providing writers with “extensive freedom in style 
and locution,” as editors we operate as a medium connecting writers to oth- 
ers through tone and address. Murray recognizes that we work “assiduously 
with bloggers to keep posts accessible to the broad audience of the blog.” 
Not only does our credibility as a resource lie in the editorial work we do, 
but we also believe that our “peer-to-peer” editorial relationship provides 
an important foundation to the blog, improving the tone and quality of the 
writing and benefiting the sound studies community itself. 

Hosting, of course, does not mean the material is presented “as is.” 
Quite the opposite. We work extensively with our guest writers to help them 
develop their ideas and address questions they may not have considered. 
Associate Professor Marci McMahon, for example, muses about the editorial 
process: “This was actually much tougher than writing a standard scholarly 
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journal article. The editorial process is rigorous and the expectation to 
write a smart, pithy, and clearly understandable piece in 1,500 words is not 
easy to do. The editorial staff is tough and demands a lot from your work!” 
Contrary to academic journals, we do not expect “finished” essays the first 
time around, and we tell our writers their drafts will go through at least two 
rounds of edits, the first of which will be developmental. 

In addition, we are open to unsolicited contributions and have a very low 
rejection rate, something we take much pride in, especially given how many 
respondents remarked on our quality and high standards. Sometimes our 
editorial collective will reach out to writers for posts, and other times writers 
will pitch an idea to us to see if we would be interested in the full draft. Once 
assigned to a project, a member of our editorial collective reaches out to the 
writer, making themself available for questions, pitches, and quick reads 
of difficult passages. Our guidelines explicitly ask for a first rather than a 
final draft, enabling writers to send early idea-driven versions that open up 
possibilities for dialogue between writers and editors in successive drafts. 
Rather than issuing global comments about a piece and then leaving the 
writer to decode them in solitude, Sounding Out! editors use Word or Google 
Docs to leave in-text notes that writers respond to directly, another form of 
community by microintervention: we are asking questions, recommending 
sources, leaving observations inspired by the draft, suggesting other schol- 
ars to contact, sending relevant links, explaining why we made a particular 
change, making connections to their own work, commending a particular 
point or turn of phrase and pushing for more. Dropping in jokes, emoticons, 
and emojis along the way, we’re finding unique ways, in context, to imag- 
ine and discuss the next iteration of the post. Using the “track changes” 
function, editors also make grammatical, syntactical, and organizational 
changes directly to the text, carefully sculpting the piece’s rhetorical flow 
and helping writers make new connections. Writers often work with mul- 
tiple editors—one or more for each draft, all working on the piece toward 
the goal of publication—widening the margin-note conversation beyond 
narrow notions of expertise and ensuring each post will speak to multiple 
audiences. Jennifer often pairs graduate students and early-career scholars 
with editors in their field whom they have not yet met, so that they leave 
the editorial process with a new connection and a short-term working re- 
lationship that may lead to future information sharing and collaboration. 
The pleasure of meeting new people and strengthening network bonds is a 
key part of our model. Where magazines and other for-profit journals offer 
money, we offer community and connections—and therefore rigor and 
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accountability. Writers and editors are thus accountable to each other and 
each has a stake in a piece’s successful publication. 

Our survey respondents agreed that the editorial process is long, and 
those who have published in traditional academic journals often compare 
the process with peer review—the result being that Sounding Out! always 
emerges as more detail-oriented and exacting. However, they don’t see 
this as a negative thing. One of our writers, a PhD candidate, described the 
process as “a little too hands-on,” but most of the other responses saw the 
process as essential to their pieces. A graduate student when he worked with 
us (now a PhD and writing center director), Airek Beauchamp states, “The 
editorial process was rigorous and ultimately transformative, in the best 
possible way.” Pefia Ovalle mentions that “the editorial process is exem- 
plary. Thanks to the incredible feedback, my work was pushed and polished 
in a way that exceeds the standards of many traditional scholarly print 
publications.” This is not to say that editors at academic journals are not 
careful or detailed; however, we acknowledge that developmental editing 
is time consuming and “inefficient”; most scholarly journals cannot find 
enough willing editors of this stripe with field expertise, particularly with 
dwindling budgets. And, certainly, both editors and writers must constantly 
balance Sounding Out!’s pleasures with the knowledge that our unpaid work 
may likely go unsung and uncredited by our institutions and supervisors. 

However, our guest bloggers find our process pleasant and helpful, 
and they notice that we do, too.” While our labor remains “free,” it is also 
freely given—and we strive to ensure the relationships we build give back. 
In contrast to how some authors may describe working with an editor as 
grueling, our writers for the most part enjoy working side by side with their 
editors. For example, PhD candidate Enongo Lumumba-Kasongo states, 
“I have thoroughly enjoyed the editorial process. Aaron [Trammell] has 
been nothing but professional, timely, forgiving, and very thoughtful in 
his critiques and suggestions.” This emotional connection helps establish 
Sounding Out! as acommunity, bringing writers back to write for us again and 
again. Ceraso articulates the connection: “From the start, I felt that Jenni- 
fer Stoever] genuinely cared about each contribution.” Our process has been 
especially helpful in increasing international communication in the field. 
Finnish PhD student Kal Ahlsved responds, “Since English is not my first 
language I am very thankful for the editorial patience. I really learned a lot 
about how to hold a thought and to follow a stream of thought.” In addition 
to enjoying the editorial team’s field knowledge and writing skill, writers 


D 6 


notice—and respond positively to—the “patience,” “enthusiasm,” and, as 
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Lumumba-Kasongo puts it, “positive feedback and words of encourage- 
ment, something that actually makes a huge difference when being asked 
to rework something multiple times.” To our surprise and delight, several 
respondents reported being inspired by our editorial praxis in their work in 
other venues, both on- and off-line. 

Our editorial process brings out the “digit” in “digital,” as Bratich would 
say, humanizing our community and making it feel realized rather than 
“imagined.” The guest writers who responded to our survey do not see 
Sounding Out! as a gate that keeps them out of sound studies, but as repre- 
sentative of a group of people who are interested in developing their ideas, 
helping the quality of their writing and recording (our podcasters also go 
through this editorial process), and amplifying their work throughout our 
networks. We work hard to ensure that our writers—particularly junior 
faculty, graduate students, community workers, and artists—have a chance 
to share their ideas with a broader scholarly community, exciting new ideas 
that otherwise might have been rejected from traditional academic journals 
and set aside, perhaps forever. Because scholars burn out when they go un- 
heard, we perform the emotional care-work of supporting our colleagues 
who stand at the margins of academia. 


PRESENCE/PRESENT/IMMEDIATE: Social Media 
and Microinterventions 


Building from our personal editorial relationship with writers, our social 
media presence has been integral to creating the kind of “big tent” sound 
studies readership we imagined for Sounding Out!, while potentially reaching 
people outside of academia like those in the art world, the sonic professions, 
and the friends and family of Sounding Out!’s blogging crew. As we discov- 
ered early on, merely placing information on the web does not build com- 
munity in and of itself. To encourage a cross-platform community centered 
around but ultimately reaching beyond the “mothership,” we worked hard 
to craft a distinct purpose for each social media outlet, a move that also en- 
abled all members of the editorial collective to curate their own unique, but 
connected conversations. In other words, our Twitter, Facebook, and Tum- 
blr feeds are not adjacent to the blog; they are so! 

While our social media presence seems Sounding Out!’s most readily 
apparent community-building enterprise, the path toward a functional, 
connected network has been anything but clear. Each medium—WordPress, 
Twitter, Facebook, iTunes, Tumblr, Google Plus, Reddit, and a monthly 


108 > TRAMMELL, STOEVER, AND SILVA 


FIGURE 4.8 A greyscale 
version of the so! logo 


(created by artist Dan Torres), 


SS 
SOUNDSTUDIESBLOG.COM 


which is emblazoned across 
all our platforms. 


emailer that goes out to more than 1,100 subscribers—has its own conven- 
tions, protocols, and even audiences, and it took much brainstorming, trial, 
and error, to discover how to reach out effectively. Our respondents under- 
scored this point as they shared how they connect with us on many social 
media platforms. As we played around with different social media profiles, 
Sounding Out! held fast to two main concerns: legibility and accessibility. 
We wanted to ensure that interested parties at each access point in Sound- 
ing Out!’s constellation of social media would immediately recognize our 
“digits” at work yet would also find unique information and conversations 
there. Such diffusion, we felt, would enable more mobility for the sound 
studies community—not being housed or affiliated with any one virtual 
location—and offer an increasingly diverse range of ways for interested 
parties to feel connected, share information, join conversations, reach out 
to each other, and spread the word through shares, likes, retweets, reblogs, 
“+1s,” and up-arrows. 

According to our respondents, Twitter is the platform where we make 
the most sound waves outside of WordPress. Inspired by Liana’s microb- 
logging as @Literarychica, Jennifer took on Twitter about a year after 
Sounding Out!’s founding, and she has steadily cultivated a feed of artists, 
scholars, presses, archives, organizations, programs, digital humanists, 
and public figures, a diverse well from which to retweet calls for papers 
and sound-related news, articles, events, releases, job listings, and media 
clips to Sounding Out!’s 5,415 Twitter followers (as of January 2018). Twit- 
ter folks can also subscribe to the curated list of more than five hundred 
“soundtweeps” to tap immediately into a more concentrated conversation 
regarding audio culture. Jennifer also regularly livetweets conferences, 
talks, speeches, art openings, and other cultural events of interest to Sound- 
ing Out! followers and passes on information gleaned in her own research 
in the field. Followers use the @soundingoutblog handle to ask Jennifer 
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FIGURE 4.9 SO! contributor 
Steph Ceraso spotted repping 
the blog by fellow so! writer 
and recent PhD Tara Betts at 
the Feminism and Rhetoric 


conference in January 2014. 


questions, crowdsource problems, pitch a post idea, seek knowledgeable 
parties, and share their own news and interesting web clippings for Sound- 
ing Out! to retweet. 

These exchanges make a difference. Lumumba-Kasongo, for example, 
describes “a number of positive exchanges with other individuals who have 
learned about my research interests through tweets that were sent from 
Sounding Out!,” including a moment when we mentioned his “piece on au- 
dio games to someone on Twitter who mentioned an interest in sound and 
games, and we ended up having a nice dialogue about some of my discussion 
points.” The flow of conversation moves outward and in unpredictable ways. 
Jennifer frequently interacts with followers by asking questions, seeking 
writers, commending observations, asking for collaborations, engaging 
with memes and hashtags, cracking jokes, and calling out misinformation 
and/or bad practice. Finally, she regularly updates followers on Sounding 
Out!’s writer-related news like graduations, publications, promotions, per- 
formances, and travels, personalizing the community and building affini- 
ties within and without the always-expanding Team Sounding Out! There is 
some content crossover for the 3,935 (as of January 2018) folks who have 
liked our Facebook page, but with an increased emphasis on providing an 
archive of sound studies CFPs through Facebook’s “notes” feature; images 
and lengthier informal updates from relevant conferences Sounding Out! 
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editors attend; and a community-building photo series that encourages 
readers to send in images of so! stickers—paid for by us and distributed for 
free—that they spot around the globe. 


Writers, Readers, Sharers 


Our work at Sounding Out! is not limited to hosting content and tweeting 
news; we are always thinking of our readers as well. Indeed, many of our 
guest writers are regular readers of Sounding Out! and feel a long-term stake 
in the blog even after the editorial process ends. Many of our writers con- 
fessed that they continued to read the blog on a regular basis after their 
work was featured. Wanda Alarcon, a PhD candidate when she took our 
survey, describes herself as “reader, guest contributor, fan.” The use of the 
word “fan” in this instance points to admiration of the blog and pleasure in 
reading it on a regular basis. Ahlsved mentions that he reads the blog regu- 
larly and that he often shares relevant pieces with his peers. Sterne says he 
“looks forward to reading it every Monday morning,” referring to our first 
post of the week. Assistant Professor Jentery Sayers also admits to being 
“an avid reader.” The regular but measured pace of the blog helps readers 
keep up with the content, with one or two new pieces a week and a podcast 
per month. However, the content reigns supreme; because the writers know 
how much care goes into each post, they are assured that every post is a well- 
written addition to the field. 

The fact that writers continue reading, sharing, and interacting with 
the blog—be it through likes, comments, contributions to our annual 
Blog-o-Versary mixtape, or sporting a sticker or button—shows that they 
feel invested in the community of the blog. Readership is not a passive ex- 
ercise but in fact supports the scholarship of other scholars. When asked 
to describe the best part of being involved in Sounding Out! over the past five 
years, Soundbox cofounder and Duke PhD candidate Mary Caton Lingold 
says that it has been “getting to know scholars from other institutions and 
being able to share work and ideas with them.” Drury reiterates this feeling: 
“I have found it useful to learn about the work others are doing in the field.” 
Bill Kirkpatrick, associate professor, sums up these ideas nicely, admitting, 
“The best part has been feeling like part of a community of scholars. I ap- 
preciated being invited to participate, and I like reading what others have 
to say.” The responses indicate that reading is a way of enacting scholarly 
citizenship as well as keeping up with what’s going on in Sounding Out! 

Although pressures from the job market and tight tenure clocks demand 


THE PLEASURE (IS) PRINCIPLE + 111 


FIGURE 4.10 Every July we 

commemorate our first post by 

, , , producing an annual collective 

mixtape with song suggestions 

from the year’s contributors. 
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an ethic of writing from us as scholars, it is important to remember that 
reading is an integral part of the community loop. Good scholarship means 
writing and reading, and even sometimes writing an addendum in the com- 
ments about the post. The ethic of readership and participation fostered by 
Sounding Out! is, in fact, a solution to the manifold academic predicaments 
that have become readily apparent in the past thirty years. If we are to survive 
as a profession, we must rise to meet the demands and opportunities of today’s 
new media platforms. As Clay Shirky articulates, “Media is a triathlon; it’s 
three different events. People like to consume, but they like to produce, and 
they like to share.”*° We must become participants who read, write, and offer 
timely feedback to others in the field on a regular basis. 


Conclusion 


So in the end, you probably don’t need to read between these lines to know 
we also do it for love. 

And, ina sense, love is the affect that has sustained Sounding Out! and its 
affiliated network for the past five years. As social theorist Michael Hardt 
suggests, although the production of value from affect is often exploited 
by patriarchal and capitalist institutional forms, there exists a tremendous 
potential for affective labor to subvert dominant institutional configu- 
rations.” To this point, our firsthand experience and survey data show a 
thriving digital community that is paradoxically treated with apathy by the 
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FIGURE 4.11 Discussing our feelings about the tensions of love and labor as 


first-generation college students and “nontraditional” scholars in academia, 


marginalized by various intersections of race, gender, and class. 


bureaucrats and administrators with whom we work. What goes unsaid, 
underappreciated, and seemingly unrecognized by these same bureaucrats 
and administrators is the digital network infrastructure that sustains our 
community of practice as sound studies scholars. 

Furthermore, as the field of sound studies inevitably institutionalizes, 
it will be all the more important to have a vehicle that amplifies the granu- 
larity of the field and wards off status-quo normalization with increasingly 
radical linkages, particularly between the humanities and the sciences. But 
whether located in a department or dispersed across the disciplines, the 
sound studies that Sounding Out! will continue to work toward is civically 
engaged, participatory, increasingly transnational in scope, decolonial in 
theory and epistemology, and invested in applied knowledge and praxis-as- 
intervention. We don’t want just to change the field, we want the field to 
change the world. We are betting on the form of the blog to do just that. 

Although we find this infrastructure fundamental to our scholarly mis- 
sion and our livelihood as public academics, the intellectual value produced 
from our collective labor is diverted into traditional publishing endeavors 
such as print journals and books. Far from denigrating the value of these 
traditional forms, we aim here to locate a problematic in what is valued by 
the institutions for which we work and to suggest that the mostly uncom- 
pensated affective labor of blogging is “more than just a print journal exten- 
sion” or a “compromise technology’—two modes Ashley Dawson rightly 
critiques—and it must be recognized if the imbalance of today’s academic 
publishing industry will ever be rectified.” So even though we did it for love, 
our digital publishing honeymoon is over. 

We will continue to “sound out” the invisible lines of practice that con- 
stitute our site and other rigorous digital publications. Digital platforms— 
conjured into existence by a need for connection and the immediacy of 
scholarship on topics at hand—must be seen for what they are: the new 
configuration of the academy. And, as such, the work of editing (developing 
scholarship and community) must come to be valued by our institutions as 
much as the act of writing. There must be a recognition that reliability and 
trust stem from rigorous editorial processes as much as they do prestigious 
titles. And, perhaps most fundamentally, the microinterventions (tweeting, 
retweeting, linking, soliciting, challenging, and connecting) necessary to 
running a successful publication must be recognized as valuable labor in 
this new network and compensated with pay, positions, and prestige. 

Sounding Out! continues to reward both us and the community, and this 
sustained sense of pleasurable community contact keeps us engaged on a 
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fundamental level. We believe in the community effort that has both con- 
structed and supported us, and we are proud to have seen terms such as 
“reader,” “fan,” and “inspiration” repeated in the survey results. We’re in 
this together, and we must start the process of recognition by collectively— 
and loudly—revealing to our friends, colleagues, bosses, advisors, deans, 
provosts, and interested peers the affective labor practices that constitute 
our network, so that they can build awareness in turn about how much 
damn work goes into digital publishing. 
And we must start by making more mixtapes. Always more mixtapes. 


NOTES 


1 These three categories represent the varied positions of the editorial collective 
at the time of writing. Over the course of the blog’s existence, Jennifer has 
become tenured, while both Liana and Aaron have finished their dissertations. 
Aaron has successfully completed a postdoctorate and obtained a tenure-track 
job, and Liana has served as editor of Women in Higher Education, as well as 
being a freelance writer and editor. She is now a secondary school educator. 

2 This is, in fact, what happened in Jennifer’s otherwise successful tenure 
case. Although she provided extensive materials documenting the formation, 
growth, and impact of Sounding Out! (with extensive digital examples), and 
her supportive department took the proactive step of procuring an outside 
evaluator strictly for her digital scholarship—whose letter commented very 
rigorously and favorably on so:—the evaluating dean undermined these efforts 
and her digital labor by describing “the blogspot Sounding Out!” as “a valuable 
service to our academic community” and therefore only an indirect contribu- 
tion toward her “multifaceted” case for tenure. These were all concerns raised 
at the 2013 Modern Language Association workshop on digital scholarship 
and tenure, where Jennifer and Sounding Out! were selected as case studies 
to help scholars and administrators think through blogging and tenure. A 
panel at the 2014 annual meeting of the Organization of American Historians 
focused on precisely this question, featuring five different historical bloggers 
who addressed whether they considered their blogs scholarship. Points of view 
were mixed. 

3 cummings, “since feeling is first,” Selected Poems, gg. 

4 We use “counternarrative” here to signal our intellectual solidarity with criti- 
cal race studies methodology, in which researchers use storytelling methods 
to legitimate the extensive experiential knowledge of marginalized peoples 
and center conversations about race and power sublimated by dominant nar- 


THE PLEASURE (IS) PRINCIPLE - 115 


ratives. Also, as Daniel G. Solórzano and Tara J. Yosso argue, the term “offer[s] 
a liberatory or transformative solution to racial, gender, and class subordina- 
tion” (24). 

As of July 12, 2016, Sounding Out! was one of seventy-seven publications that 
were available only online and had no pagination. 

Drobnik, Aural Cultures, 10. See also Aparicio, Listening to Salsa; Johnson, 
Listening in Paris; and Kahn, Noise, Water, Meat, on avant garde art and radio. 

See Kun on American literary and musical audiotopias (Audiotopia); Moten on 
the black radical tradition (In the Break); Picker on nineteenth-century sound 
(Victorian Soundscapes); Trevor Pinch and Frank Trocco on the synthesizer 
(Analog Days); Rath on early American soundscapes (How Early America Sounded); 
Bruce Smith on Shakespeare (Acoustic World of Early Modern England); Sterne on 
nineteenth-century audio technologies (Audible Past); Thompson on modernity 
and architecture (Soundscape of Modernity). A handful of formative anthologies 
were released in 2004: Bull and Back, Auditory Culture Reader; Erlmann, Hearing 
Cultures; Mark Smith, Hearing History; Drobnik, Aural Cultures; and Cox and 
Warner, Audio Culture. 

For more on the methodology ofa field in transition, see Hilmes’s “Is There a 
Field Called Sound Culture Studies?” 


8 Williams, “Community,” 75. 
9 Bratich, “The Digital Touch,” 307. 


10 
11 
12 
13 


14 


15 


16 


17 
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Sundén, “Technologies of Feeling,” 147. 

Sample, “What’s Wrong with Writing Essays?” 

Boon, “One Nation.” 

In particular, the Sound Studies Caucus in the American Studies Association, 
the Sound Studies and Radio Studies Special Interest Groups in the Society of 
Cinema and Media Studies, the Music and Sound Interest Group in the Amer- 
ican Anthropology Association, and the Sound Studies Interest Group in the 
Society of Ethnomusicology have been key foundational professional groups. 
In 2012 and 2014 Sounding Out! cohosted “meet and greets” with the Sound 
Studies Caucus at the American Studies Association annual conference. 
There is now a dedicated print journal, Sound Studies, whose first issue was 
published in 2015. Jennifer is on the founding editorial board, no doubt due at 
least in part to her work on Sounding Out! 

This is a problem in the digital humanities in general, as McPherson addresses 
in “Why Are the Digital Humanities So White?” 

Even with recent compromise measures such as the inclusion of a cD at the 
end ofa text or sound clips on an online “tie-in” site, written pieces have 
largely had to stand alone, without a sonic dimension, however necessary it 
might be to the analysis performed. Referring to these sounds is like referring 
to a text absent from the bibliography. 

“I could actually have audible examples to accompany my analysis” says one 
respondent to our survey. “When writing my guest posts I could think/write 
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along with audio/video samples in mind simply because I knew that it was 
possible and also because it was the expectation,” says another. 

18 See Cohen’s “The Blessay” for a distillation of this debate, particularly con- 
cerning writing at the intersection of journalism and scholarship. 

19 We take the term “always on” from boyd’s “Participating in the Always-On 
Lifestyle,” in which she discusses the pleasures of staying connected and 
suggests hacks to make an “always-on” existence less taxing. As she argues, 
“There’s nothing like being connected and balanced to make me feel alive and 
in love with the world at large” (74). We agree. 

20 O’Reilly, “What Is Web 2.0?,” 41. 

21 Sundén, “Technologies of Feeling.” 

22 See Charmaz, Constructing Grounded Theory, 3-4. 

23 Fitzpatrick, Planned Obsolescence, 43. See our full editorial statement online at 
http://soundstudiesblog.com/editorial-statemen, and our mission statement at 
http://soundstudiesblog.com/sound-studies-blog/mission. 

24 Taken from our survey. 

25 Shirky, “Gin, Television,” 239. 

26 Hardt, “Affective Labor,” 100. 

27 Dawson, “D.I.Y. Academy?,” 261, 271. 
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BECOMING OUTKASTED 


Archiving Contemporary Black Southernness 


in a Digital Age 


REGINA N. BRADLEY 


I didn’t expect “OutKasted Conversations” to catch so many people’s atten- 
tion. It started out as a pet project, a way to celebrate the Atlanta, Geor- 
gia, duo OutKast’s twentieth anniversary in hip-hop. OutKast, an acronym 
for Operating under the Krooked American System Too Long, heavily in- 
fluenced my coming of age in southwest Georgia in the 1ggos. Their mu- 
sic offered a blueprint for thinking about black southern folks’ lives (and 
why they mattered) after the civil rights movement. OutKast introduced the 
world to the funkiness of what hip-hop could do in the South, opening doors 
for the complexity of southern black life—pain, pleasure, remembrance, 
and perseverance. OutKast’s body of work gave young southern black folks 
the green light to embrace their experiences and carve out a space to rec- 
ognize their own agency rather than dismiss it as a side effect of the civil 
rights movement. “OutKasted Conversations” moved that conversation and 
recognition past music into the digital realm, creating a digital site for teas- 
ing out how hip-hop can serve as a catalyst of change in the post-civil rights 
American South. 


The Project Premise 


“OutKasted Conversations” started as a lively conversation with friends 
over lunch about hip-hop albums celebrating their twentieth anniversaries 
in 2014. Names of now-iconic albums were thrown across the table over our 
lunches: Notorious B.1.G.’s Ready to Die, Da Brat’s Funkdafied, Warren G’s Reg- 
ulate . . . G Funk Era, Scarface’s The Diary, and Nas’s Illmatic. My colleagues/ 
friends—Bettina Love, Emery Petchauer, and Christopher Emdin—were 
most vocal about their excitement around the festivities regarding Illmat- 
ic’s anniversary. The album’s anniversary would be well acknowledged, in- 
cluding a documentary Time Is Illmatic and a live orchestra performance of 
the album at the Kennedy Center for the Arts in Washington, D.C. For my 
colleagues, mostly reared in the Northeast, Illmatic represented the angst 
of growing up black at the end of the twentieth century. Illmatic provided 
artistic context for the socioeconomic disparities and strife affecting black 
urban America in the 1980s and early 1ggos in the aftermath of the Reagan 
administration. Granted, IIlmatic’s sophistication lies in its cross-section of 
jazz aesthetics and gritty, street storytelling, sonically and culturally pull- 
ing from the trope of New York as a hard and bustling city. For example, the 
consistent use of jazz piano, turntable scratches, and the sound of rustling 
subway trains along their tracks make Illmatic a masterful demonstration 
of hip-hop’s function as a site of urbanity and contemporary black culture. 
However, I didn’t share the same level of excitement as my friends be- 
cause my love of hip-hop didn’t come of age in the Northeast. When Nas 
asked “Whose World Is This?” or declared a “New York State of Mind” (two 
tracks from Illmatic), I was not his intended audience. I was a country girl 
from Albany, Georgia. Tractors commanded the roads dusted over by dirt 
coming from fields of cotton, corn, and melons. Red clay was never idle if 
white shoes were nearby. Noisy cicadas and crickets fussed at each other 
early in the morning and late at night. OutKast was prominent on my play- 
list, helping me work through and recognize what it meant to be young, 
southern, and black. Many young black southerners used OutKast to find a 
voice amongst the murmurs of the past and present that flowed in and out 
of our everyday lives. Southern hip-hop provided a space for recognizing the 
complexity of a more current moment of black southern identity: coming to 
terms with the strides and shortcomings of the civil rights movement while 
taking joy in being young, southern, and black. OutKast demonstrated young 
southern blacks could dance and critique, laugh and mourn, and carve out 
space for unorthodox perspectives. OutKast’s body of work offered a type of 
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sensibility that catered to my southernness. They offered a rich sonic tap- 
estry of historical southern black sensibilities—ring shouts, blues, gospel 
choirs and the black church, for example—while using hip-hop to establish 
their knowledge of self and while complicating the context of the South in 
hip-hop culture. Although urban southernness is more embraced in hip-hop 
today, OutKast introduced the possibility of the South as a contemporary 
and urban space. They cataloged Atlanta using a hip-hop hybrid of lyricism, 
spoken word, gospel, and funk music. OutKast signifies on rural and urban 
southern tropes to acknowledge the possibility of young southern blacks 
being able to carve out space within hip-hop while sustaining a narrative 
parallel to (not submissive to) the civil rights movement. I was excited for 
OutKast’s reunion tour in honor of the twentieth anniversary of Southern- 
playalisticadillacmuzik. I was never old enough to go to a live performance 
when they were actively touring. Seeing a reunion performance (or three) 
was at the top of my list. 

My initial premise for “OutKasted Conversations” was to create a space 
to celebrate OutKast’s overall dopeness. I wanted to recognize their music 
and artistry as innovative and critical to hip-hop’s development as a culture. 
As a scholar and member of the post-civil rights black South, I set out to 
celebrate OutKast’s accomplishments and center them in more critical con- 
versations taking place in (new) southern studies and hip-hop studies. In 
addition to providing a critical backdrop for thinking through OutKast’s 
reunion tour, I also wished to push discussions into the multiple facets that 
OutKast covers in their work, including race, gender, education, economics, 
spirituality vs. organized religion, sexuality, and identity in the post-civil 
rights South. And, like OutKast, I wanted to extend the conversations we 
had about their work outside of cafeteria tables and back into mainstream 
discussions of hip-hop. 

YouTube provided a platform to update the cafeteria-table talk trope: 
its easy access invited viewers to “pull up a chair” to the conversation, 
(re)introduce themselves to OutKast’s music, and discuss how they can be 
positioned in hip-hop and in the academy. Hosting the series on YouTube 
simultaneously archived the discussion and pushed back against the way 
one listens to and critically engages with hip-hop in digital spaces. It served 
as a curatorial space, a means for me to select and engage the types of stories 
and critical approaches necessary to reinvigorate conversations about Out- 
Kast’s contributions to hip-hop. OutKast is the first southern hip-hop group 
to gauge contemporary scripts of blackness while referring to the past to 
annotate their southernness. “OutKasted Conversations” served as a digital 
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complement to OutKast’s undertaking of the continuous task to recognize 
southern black folks’ cultural and sociopolitical agency in a more contem- 
porary form. Perhaps most importantly, “OutKasted Conversations” exper- 
imented in digitizing the experiences of the contemporary black South, an 
effort to create a “playlist” of interviews that conceptualize and add depth 
to considerations about how hip-hop and regional identity merged to create 
new digital identities in the post-civil rights American South. 


Aesthetic Influences 


“OutKasted Conversations” is a critical dialogue series recorded on Goo- 
gle Hangout and hosted on my YouTube channel. The series concludes with 
a playlist boasting forty episodes and interviews with fans, scholars, and 
artists who enjoy and are familiar with OutKast’s work. The interview and 
conversational format borrows from Mark Anthony Neal’s “Left of Black” 
series of webcasts. Neal’s use of social media as a platform for public schol- 
arship and education is a useful model for connecting critical frameworks 
to nonacademic audiences. “Left of Black” features an interdisciplinary fo- 
cus that provided context for crafting “OutKasted Conversations” as a site 
for multiple entry points of analysis about the contemporary South using 
OutKast’s work. “OutKasted Conversations” uses new media as an interven- 
tion for new southern black studies using hip-hop. I used this project to ex- 
tend conversations about the post-civil rights South offered by scholars like 
Imani Perry, Zandria Robinson, and Riche Richardson.’ Perry, Richardson, 
and Robinson include OutKast in their analysis of southern identity poli- 
tics and spaces, but they do not centralize the duo’s work in their respective 
studies. “OutKasted Conversations” is the first project of its kind to central- 
ize OutKast as a cultural framework for analyzing race and identity in the 
post-civil rights South. 

Further, this project’s social-media format evokes Zora Neale Hurston’s 
approach to ethnographic study. Hurston’s training as an anthropologist 
allowed her to document and record southern black folklife in the 1930s 
for the Works Progress Administration. Her influence is significant to this 
project because she was a black woman archiving southern black life while 
participating in the culture she observed. Myron Beasley’s discussion of 
Hurston’s place as a subject of digital scholarship (chapter 2 in this volume) 
adds further context to considerations of how black culture resonates within 
digital spaces. Beasley acknowledges Hurston’s sonic ethnographic studies 
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as immersive and necessarily self-subjective scholarship. Hurston’s use 
of sound and recording tools created an alternative space for articulating 
southern blackness. It offered Hurston the opportunity not only to record 
the stories of marginalized southern black folks but also to record herself 
and her perspective into cultural history and memory. Beasley writes that 
Hurston’s sonic work “eliminate[s] boundaries between the scholar and the 
participants and mak[es] known the cultural politics of doing fieldwork and 
producing creative and accessible ways of (re)presenting scholarship and 
creating new texts.” 

Additionally, Beasley’s marking of digital media as comprising a “con- 
tested space” doubly binds the scholarly development of technology to 
region and gender. Hurston’s sonic ethnography laid the groundwork for 
my own because it intentionally existed between the grooves of its audio 
recordings, purposely inhabiting the interstitial spaces between what is 
considered traditional and public scholarship. Hurtson’s body of work rec- 
ognizes that the (rural) black South did not fit onto a typecast page or within 
the framework of traditional critical anthropology. Thus, she used sound 
and sound production in all their manifestations—whether she was literally 
spelling out dialect in her creative writing or recording the sound of her own 
voice as it connected to the larger conversation taking place via southern 
folklore and song. Her body of work ruptures cemented expectations of race 
and scholarship in the academy and among the public. She demonstrated 
the highest levels of public scholarship by situating herself within the 
public. Hurston is a part of the culture she studied, which left room for her 
subjects to tell their own stories in their own ways. 

As a southern black woman scholar working with digital media, I find 
Hurston’s model of sonic ethnographic study useful for creating space to 
think through and record the experiences of those viewpoints otherwise 
overlooked in cultural studies. Each episode serves as a mini-rupture or 
intervention that leads to viewing OutKast (and ultimately southern black 
popular culture) as a framework for contemporary black identity. Like 
Hurston, I actively participated in each interview, sharing my own stories, 
humor, and excitement about the lasting relevance of OutKast’s work on my 
self-identification as a young southern black woman. My engagement with 
each interviewee states my vested interest in their stories and ideas. My being 
“present” as a subject as well as the moderator of each conversation—just 
as Hurston was in her ethnographic studies—allows “OutKasted Conversa- 
tions” to blur the lines between curating articulations of southern blackness 
and participating in the articulation of southern blackness. This is import- 
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ant because black cultural expression, especially southern black culture, 
ebbs and weaves between active participation in culture and its creation. 


Interviewee Selection and Discussion Question Samples 


To discuss the significance of OutKast’s contribution to popular culture, I 
intentionally selected the majority of project interviewees for their southern 
backgrounds or intimate knowledge of the South. Their southern sensibili- 
ties came from multiple vantage points—I interviewed guests who grew up 
in Mississippi, Georgia, Louisiana, Florida, Tennessee, and Texas—which 
lends credence to the project’s main objective: identifying and clarifying 
how OutKast signifies a complex and nonmonolithic southern black expe- 
rience. Interviewees were also selected for their fresh insights, innovative 
scholarship, and willingness to help promote the series. Upon their agree- 
ment to participate, I sent each interviewee a list of questions to help steer 
the direction of each interview. Questions were geared toward the interview- 
ees’ area(s) of expertise. The resulting conversation led to a unique and excit- 
ing use OutKast’s work to understand race and identity in the contemporary 
American South. 


Crafting “OutKasted Conversations” 


Each interview began with the question “How did you become OutKasted?” 
This question is pivotal to the entire interview. It is a unifying thread of 
commonality for the project and breaks ground for archiving one’s personal 
experiences with OutKast. The question also speaks to the significance that 
the act of listening plays in articulating a cultural framework of one’s lived 
experiences. As interviewees shared their stories they also revealed how they 
listened to OutKast, when they listened to OutKast, and why they listened to 
OutKast. Their responses laid the groundwork for more traditional methods 
of analysis to take place in the interview. The act of listening served as a pri- 
mary method of engaging OutKast’s music as a critical framework for race, 
class, and identity politics in the post—civil rights South. “OutKasted Con- 
versations” collected stories about the varied listening practices surround- 
ing OutKast’s music. I used them to create a cultural reference point for 
contemporary southern black culture. The act of collective listening over- 
lapped with the act of “collective watching” via YouTube. Both the series and 
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the digital platform are grounded in personal tastes in streaming, forms of 
consciousness, listening preferences, and sociocultural attachments. The 
interviews extend the way collective cultural memory ona single subject can 
merge and “stream” in digital spaces. For example, in an interview with DJ 
Jelly, the first DJ in Atlanta to play OutKast’s breakout track “Elevators” from 
the ATLiens album, Jelly discussed his initial listen of the song on vinyl. Jelly’s 
discussion of breaking the record on air using a vinyl LP demonstrated the 
collective act of listening: radio listeners calling to request the song after 
hearing it, OutKast’s transition from a local Atlanta hip-hop group to the 
national hip-hop stage, and the physical act of listening—which encom- 
passed the transition from vinyl albums to compact discs and highlighted 
the role of the Dj as a curator of sonic cultural memory and experience. Ask- 
ing interviewees about their initial experiences listening to OutKast posi- 
tions listening as an act to collapse binaries of public/private cultural mark- 
ers and gendered expressions of southern identity. 

Further, consider episode four, which features Dr. Treva Lindsey, an 
assistant professor in the Department of Women’s, Gender, and Sexuality 
Studies at Ohio State University. She is also a member of the Pleasure Ninjas 
Collective, a group of black feminist scholars who interrogate pleasure as a 
form of resistance and reclamation of power in black women’s lives. Lind- 
sey’s episode focuses on the connections between the sonic and pleasure in 
OutKast’s work. Lindsey’s theorization of “user-friendly” patriarchy high- 
lights the nonabrasive yet misogynistic undertones of women’s narratives 
heard in OutKast’s music while also pointing out how their sonic cues of 
womanhood—moaning and laughter, for example—demonstrate the rich 
complexity in utilizing OutKast’s music as a critical framework for under- 
standing gender and sexuality in hip-hop. Lindsey’s interview offers sound 
as an alternative framework for analyzing contemporary issues of race and 
sexuality. The digital format of the interview was useful here because Lind- 
sey could sonically demonstrate the oral indicators of black women’s sexual 
politics used in OutKast’s music. The video interview allowed for a sonic and 
academic performance of the Lindsey’s analysis, offering an immediate and 
engaging critical insight into OutKast’s work. 

Each episode serves as a multilayered standing reservoir of contempo- 
rary scholarship. The topics addressed throughout the series—from gender 
and pleasure politics to automobile culture to film studies—work well in a 
digital platform because of its immediate access. Unlike a traditional print 
journal article, where the publication process can span anywhere between 
a year and five years, digital scholarship is immediate and can be immedi- 
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ately applied to cultural studies and discussions taking place in the present. 
Additionally, the immediacy of digital scholarship feeds into the fickleness 
of public interest. The “OutKasted Conversations” series took advantage of 
a sociohistorical moment when interest in OutKast—who have not released 
new music as a group in the last decade—reignited to celebrate their inter- 
national twentieth-anniversary reunion tour in 2014. The public’s interest 
in OutKast (including those who came of age on their music and those who 
only knew them because their Coachella performance raised curiosity about 
who they were) helped buoy the progression of the series throughout its 
production. 

Further, the dialogue series signifies the blurring of the academy as a 
private and publically unresponsive space. As I state previously, the intimacy 
and lightheartedness of the conversations emphasize the crossover appeal 
of a cultural subject like OutKast in both academic and lay spaces. Viewers 
have access not only to the academic discourse but also to the voices behind 
the analysis. The interview documents not only the analysis but also its 
delivery. The critical engagement is not lost but reimagined to speak to a 
wider audience than exists inside the classroom or between the pages of an 
academic journal. 


Process Editing 


After the conversation was recorded, the raw footage was downloaded and 
edited with video software (iMovie). I minimized editing to preserve the or- 
ganic flow of the conversation and to keep intact the critical work being 
done. Perhaps the most beneficial aspect of the project for me was undergo- 
ing a public version of peer review for my work. Rather than relying on aca- 
demic experts in the field to offer insight, I relied heavily on my viewership 
to help me improve the format and functionality of the project. Feedback 
was quick, personable, and utilized with a quick turnaround in the project’s 
production. For example, the earlier interviews of “OutKasted Conversa- 
tions” (episodes 1—10) are minimally edited video from a conversation re- 
corded on Google Hangout with an attached title slide. Episodes were long, 
ranging from thirty-five to sixty minutes. 

After receiving feedback from viewers and consulting new media strate- 
gists like Mark Anthony Neal, Marisa Parham, and my partner, Roy Bradley, 
I sought to make the episodes more polished and to retain audiences by cut- 
ting down the length of each episode. I switched the format to include a title 
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slide, an introduction slide listing the guest’s name, and end credits. Each 
episode only lasted from fifteen to twenty minutes. Starting with episode 11, 
a friend and music producer, J. French, gave me an instrumental track to use 
as the series’ theme song. The song played approximately five to seven sec- 
onds and faded out after the slide introducing the episode number and name 
of the guest. To further polish the final product, I added a photograph of the 
featured guest to the introduction slide. I then exported the segments from 
iMovie and uploaded the final product on YouTube. Uploading episodes on 
YouTube made me stick to a weekly production schedule—filming the epi- 
sode and editing it a week in advance of its airing—to keep drumming up 
viewer interest and maintain a consistent presence on social media. 


Publication and Advertising 


The polished segments were uploaded weekly to YouTube and shared via 
Twitter and Facebook. I would tweet the link to the project using the hashtag 
#OutKastedConversations to track its movement across social media. I also 
tagged OutKast member Big Boi to alert him to the series and new episodes. 
By advertising via social media, I hoped to achieve additional conversations 
about the episode and OutKast with a broader scope and audience. Indeed, I 
achieved a broad audience. “OutKasted Conversations” realized nearly eight 
thousand unique hits, and over two hundred users subscribed to my You- 
Tube channel. It was featured in major digital media publications like For 
Harriet, Sounding Out!, Creative Loafing Atlanta, Huffington Post Live, the New York 
Times popular culture blog, and the Feminist Wire. The project garnered fan- 
fare on social media in the form of retweets, direct mentions, and Facebook 
(re)posts. Although there was significant support from public platforms, 
there were few fan emails or correspondence outside of the publications 
previously mentioned. 


Lasting Impact 


“OutKasted Conversations” stands as a public archive of southern hip-hop 
collective memory. Iam currently in conversations to move it to a more sta- 
ble digital platform. The focus on OutKast serves as intervention to include 
more southern voices—both literal and conceptual—in the canon of south- 
ern studies and hip-hop scholarship. Social media provided me a platform 
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to engage a subject matter and explore perspectives otherwise overlooked in 
the academy. “OutKasted Conversations” exists at the crux of sound studies 
and new southern black studies because it interrogates how critical voices 
and expertise legitimize themselves outside of academic discourse. Like the 
black southern oral traditions studied and documented by Zora Neale Hur- 
ston, “OutKasted Conversations” became a space of collective reckoning 
about how the South is rendered from a post-civil rights southern black per- 
spective. OutKast served as a subject and as a springboard for renegotiating 
contemporary black agency for those generations removed from the histor- 
ical civil rights era. These types of conversations take place in cars, around 
lunchroom tables, or through phone calls and texts. Public discussion can 
overlap with academic study to create new discourses and add deeper con- 
texts. “OutKasted Conversations” reflects the overlap of popular and aca- 
demic study by using alternative methods of analysis like sound and social 
media. It is a testament to the multiple possibilities of using hip-hop culture 
in digital spaces to update the South to reflect its present and future states. 


NOTES 


1 For links to all forty-two conversations, please visit my website at www 
.redclayscholar.com. 

2 See Perry, Prophets of the Hood; Robinson, This Ain’t Chicago; and Richardson, 
Black Masculinity. These studies contextualize OutKast and their scripts of 
blackness and masculinity within the framework of a contemporary and 
urban/postindustrial South. 
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OF LEARNING 


Pedagogical Experiments with Critical Making 


and Community-Based Ethnography 
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Teaching and learning are a series of interpretive acts. From designing a 
syllabus to enacting classroom exercises, teachers construct the value of ed- 
ucation by assigning outcomes of learning to grade values. Students main- 
tain the value of education by performing tasks in order to achieve the goals 
of classroom activities and assignments. These processes resonate with 
programmatic acts such as encoding, decoding, and enumerating. In many 
ways, pedagogical design is very similar to software design. Computational 
logic pervades much of the thinking familiar to teachers and administra- 
tors. For instance, at the curricular level, programming means breaking 
down the experience of learning into uniform components and then count- 
ing, sorting, and grouping these components based on the mission and the 
objectives of a degree program. At the course level, grading exemplifies a 
markup activity that ranks student work; and scripting in-class activities se- 
quences interactions and governs informational flow among the students 
and the instructor. 


Codifying learning leads to the evaluation of the learning outcomes 
across metric categories that have been standardized. This process of cod- 
ification interfaces with the myriad modes of learning, from reading and 
writing to classroom discussion and testing. These standardizing practices 
rank modalities of learning based on a hierarchy of senses that prioritizes 
some experiences of learning over others. For example, class participation 
is typically an embodied experience—including raising hands, voicing an 
inquiry, exchanging ideas with peers during a class discussion. In evalua- 
tion, the metric of “class participation” has lumped these sonic modes of 
learning into a single category. This category is often ascribed with little 
weight relative to other categories based in silent modes of learning such 
as final essays, midterm exams, and reading responses. The ordering of 
senses results in the privileging of writing and printed text over auditory 
processes such as listening, speaking, discussing, making, and collective 
brainstorming. 

Given the compulsory silencing of institutional learning, I ask: How 
would a sounded pedagogy reorganize the communications and informa- 
tion flow in learning? What might be some guiding principles for think- 
ing about a sound-based approach to teaching and learning? How might 
“sonifying” learning encourage students to explore a personal meaning 
of learning? Can sounds enable students to encode and decode knowledge 
reflexively across various contexts of learning? If so, how? Finally, how does 
a sound-based pedagogical approach foster collaboration and community 
building? In this chapter, I first offer a critical perspective on industrial 
models of pedagogical designs and practices that encode sounds (out) of 
the learning experience. Then I propose a series of experimental approaches 
that attempt to reprogram sounds back into learning and teaching. 


The Code of Silence 


Looking at syllabi from the past, I noticed something unusual on the History 
of Civilizations syllabus for a course offered in 1969 at Occidental College. 
In a description of the journaling assignment, the instructors state that the 
journal is “nota place to sound off.”* The use of the term “sound off” struck 
me as a peculiar way to refer to complaints about professors. Sounding off 
typically involves speaking loudly, an act that comes with a distinctively au- 
dible component. The anti-sounding-off restriction on the syllabus poses 
an unexpected dissonance to the assignment of journal writing. Journal 
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writing is typically an internal, individualized grappling with intellectual 
materials. Placing a restriction on a sounded speech act within a quiet, in- 
trospective writing exercise seems out of place. How did the instructors of 
the course imagine the sounds of learning? Are they necessarily associated 
with unruly classroom behaviors? Did they see the need to exert control over 
sounds so badly that they had to extend their policy into the sphere of indi- 
vidual journal assignment? 

In higher education accepted modes of learning, reading, and writing 
are traditionally associated with quietude.* Libraries, with quiet floors and 
individual study carrels, are conventionally designed as spaces of silence. 
Even processes of learning academic subjects with an aural emphasis like 
foreign languages and music are contained within and isolated by labora- 
tories equipped with individual stations with headphones. The silencing 
of learning extends into the course design. Courses in the humanities and 
humanistic social sciences are programmed by a series of readings and eval- 
uations. Students reflect on their learning by quietly writing a final paper 
and testing their knowledge in an exam. 

Working individually and silently makes students submit to authority. 
It can also suppress student impulse to question the purpose and modality 
of education. These classroom designs and course policies are aligned with 
the industrial mission of training students as good, quiet workers. The quiet 
worker evokes Paulo Freire’s diagnosis of education as a banking model that 
operates as a bureaucracy to maintain order and promote efficiency. In this 
industrial model, students and factory workers are objects that can be quan- 
tified for the purpose of resource and labor management.® This metrica- 
tion, the process of turning the human experience of learning into metrics 
that evaluate student performance, is in place to increase productivity and 
efficiency. In some instances, metrics are implemented to quantify faculty 
salary and other resources that go into the delivery of a class. The purpose 
of metrication, in the capitalist-industrial context, is to drive growth. For 
teachers this means the imperative to increase course enrollment, and for 
students the objective is to obtain higher grades in order to compete on the 
job market postgraduation. The grade-driven incentive for student achieve- 
ment reinforces the data-driven paradigm of classroom management. 
The continuity between the data- and grade-driven paradigms flattens the 
purpose of education by producing an efficient, compliant workforce. It is 
worth asking what other learning objectives are important besides training 
students to become productive workers without an inclination to sound off, 
especially in the current postindustrial economy. 
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Furthermore, the capitalist-industrial logic of course design can reduce 
the richness of learning to a binary between sound and silence. In its most 
simplistic case, it turns the sounds of learning activities on or off, like a 
switch that allows for silent activities such as writing and reading. In other 
instances, the industrial logic enforces the transmission of sound ina single 
direction, with the classic paradigm ofa professor lecturing over a crowd of 
silent note-takers. These programmatic mappings in learning design often 
privilege silence over sound, writing over speech, reading over discussion, 
thus reinforcing the instructor’s authority over participation and interac- 
tion.* What if the experience of learning could resound in a full spectrum 
between sound and silence, including noise, music, whispers, provocation, 
recitation, call and response, and other relevant sounding experiences? A 
reprogramming of learning calls for the rethinking of the role of sounds in 
learning beyond the dichotomy of sound and silence, ushering in classroom 
dynamics with sounds and noises that emanate from the bottom up, side- 
ways, and across. 


Reprogramming Sounds 


Sounds can chart new territories of learning. They can amplify the tacit and 
reembody a message, a set of instructions, and a corpus of knowledge. They 
can renew textures of knowledge, bringing into existence interpretations 
and inquiries of personal and social significance on a journey of learning. A 
sonic rehabilitation of learning can remodel the mission of education and 
reconfigure pedagogical relationships. Nuances of sonic modality and me- 
diation are central to the process of acquiring and embodying knowledge. 
Sonically informed insights can give us ideas for creating engaged learning. 
Foregrounding sound as a medium and modality of learning, I want to draw 
attention to how sound dynamically registers at the experiential, ideologi- 
cal, and societal levels. 

I advocate for a pedagogy that encodes sounds into the learning scaffold. 
This act of reprogramming begins with raising sound-first inquiries about 
teaching and learning so that sound is a central principle and not an after- 
thought. I employ examples from Digital Music-Cultures, a course I designed 
and taught in spring 2013 while experimenting with digital pedagogy and 
multimodality with and through sound. Combining principles of ethno- 
musicology and digital audio production practices, Digital Music-Cultures 
is an entry-level music course for nonmajors.® To create a new pedagogical 
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schema, I identified points of intervention that could be meaningfully son- 
ified through rescripting class discussion, workshops, homework assign- 
ments, and final projects. 

It is worth noting that even though the subject matter of this course is 
music, a sonic medium, most nonperformance-based music courses, such 
as music history and ethnomusicology, are taught in ways that are confining 
sonically. For instance, the listening portion ina similar course usually man- 
ifests either as a take-home assignment for individual students to engage 
with privately, in their own time, or as a drop-of-the-needle identification 
portion of a written test. A pedagogical goal of this course is to reorganize 
the experience of sounding and listening so that they are central to learning. 
Like a choir rehearsal, evoking sonically driven learning practices such as 
a call-and-response ideation, a performative demonstration of feedback, is 
treated as foundational to the course experience. 

I propose three principles to reprogram the way sounds are learned: 
remediation, reflexivity, and resonance. These principles are derived from 
a series of pedagogical experiments I conducted while teaching undergrad- 
uates from 2006 to 2073. All three interrelated and non—mutually exclusive 
principles demonstrate the intersecting possibilities between sound as a 
medium and the digital as a modality. In what follows, I elaborate on each 
of the enlisted principles with actual examples drawn from the course. 


Remediation 


Remediation refers to the transfer of content in one medium context to an- 
other.° Remediation occurs as content becomes represented across media 
contexts: for example, a film adaptation of a theater production, song lyrics 
derived from poetry, or photographs of paintings. The concept can also be 
exemplified when content transfer happens across format types: from ana- 
log to digital, from radio show to podcasts, from vinyl recordings to MP3 
files.” Further, in digital humanities, remediation can be theorized from the 
perspective of materiality. Challenging assertions of digital immateriality, 
digital humanities scholars have conceptualized the materiality of digital 
objects and processes.* Digital affordances, they contend, enable knowledge 
transformations. Through these transformations, objects of knowledge are 
reiterated and reembodied across modalities and media types.’ The techno- 
logical possibilities for visualizing textual and sonic materials have enabled 
humanities scholars to manipulate the form and format of cultural content, 
renewing the analytical context for discovery and insights.” 


134 - W. F. UMI HSU 


The pedagogical value of remediation or rematerality becomes evident 
when students wrestle with often-challenging intellectual processes across 
media contexts. Reading, discussing, making, listening, sharing, rereading, 
remaking, relistening, rewriting—these tasks are iterative remediations of 
concepts and theories from a course. Each time students remediate course 
materials, from reading to writing to discussing, they develop a deeper and 
more nuanced relationship to those concepts. 

Sonification—the act of turning nonsonic materials into sounds—is well 
poised as a remediation practice for providing a new sensory context for 
students to grapple with knowledge. It is a space for students to articulate 
relational knowledge: for instance, exploring the relationship between 
their own argumentative positions and sources of scholarly materials. 
Sonic remediation of student writing, in particular, can help students hone 
their arguments with respect to other scholarly voices and content. In my 
writing-oriented courses, I always structure an assignment asking students 
to record themselves reading a previously composed essay of their own.” 
This assignment allows students to explore their authorial voice within the 
sensory domain, enriching the experience of writing. I often see students 
attempting to sound “scholarly” in their writing. This exercise disabuses 
them of notions of having to sound scholarly. Instead of sounding like a 
generic scholar (whatever that means in their heads), I want them to take 
control, to reclaim their own voices, and to embody argumentative writing 
on their own terms. Sounds can also afford us opportunities to remediate 
scholarly concepts, which are almost always transmitted as printed text. 
In this instance, sonification can be an interpretive exercise that provokes 
recontextualizations of meanings and knowledge. Using sounds to rema- 
terialize scholarly information, students can gain multiple access points, 
including those that are embodied, sensory, and potentially affective, to 
enter into the scholarly conversation and develop a personally meaningful 
relationship with the object of intellectual inquiry. 

To experiment with sonic remediation, I ask students to sonify their re- 
sponses to their reading of a theoretical text and their viewing experiences 
ofa documentary film. Fora unit on chip music, I created an in-class exercise 
for students to explore concepts of music and noise described in an article 
excerpted from Jacques Attali’s book Noise: The Political Economy of Music and 
in Paul Owens’s documentary film about chip music, Blip Festival: Reformat the 
Planet. First, students work in groups to populate a shared Google doc with 
quotations from the Attali article that address concepts related to music and 
noise. I scaffold this class activity by providing prompts to evoke possible 
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theoretical engagements.” Students populate a list of Attali quotations 
and annotate each quotation with an analysis of how the quotation offers 
a perspective on chip music as depicted in the film.” In the following class 
meeting, held in a media production workshop, students acquire the basic 
techniques of chip music production, learning to compose music in Little 
Sound DJ, a beat-making Game Boy game simulator. For their take-home 
assignment, students compose a chip music piece as an audio meditation 
on theories related to music and noise, while referring to the peer-sourced 
list of quotations from the previous class meeting. In a reflective blog post 
describing their results, students discuss how their composition does one 
of the following: 


exemplifies or reflects an ideology (related to music, society, 
consumption, or technology) expressed by Attali, 


demonstrates a technological or musical concept discussed by Attali, 
contradicts how music (or noise) is defined by Attali, or 


explains or encapsulates the meaning of music (or noise). 


This creative assignment encourages students to engage with sonic 
argumentation—to demonstrate, extend, or undermine concepts in the 
reading—through audio production techniques.“ This multipart lesson 
ends up creating a space for students to speculate on the triangulation be- 
tween three learning components of the unit: high theory authored by a ca- 
nonical scholar, the grassroots community of chip music practitioners de- 
picted in the film, and the practice of chip music audio production. Sound, 
in this example, serves as a remediating agent that grapples with the rela- 
tionship between two texts in two different media, across two interpretive 
domains. 

Possible intellectual productivity comes to life when the students’ deploy- 
ment of an aesthetic decision via audio software techniques interlocks with 
their explorations with scholarly concepts. Something clicks—an experience 
we have all had in learning—and the fruits of interpretive efforts emerge. 
Interestingly, “clicking” is an auditory expression of a productive moment 
of intellectual grasping or knowledge discovery. A famous example of this 
is Archimedes’s exclamation, “Eureka!” I wonder if the recovery of the sonic 
dimension in learning could spur meaningful “eureka” moments. 

This assignment encourages students to engage with a deformative path 
to imagine new and creative forms of scholarship that can be “forbidden 

. either irresponsible or damaging to critical seriousness.”** Linking 
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deformative reading with digital making, Mark Sample champions a mak- 
ing approach rooted in breaking things as a predominate mode of making 
new cultural objects.*° A deformative making project refuses a “revitalized 
perspective,” deliberately not treating a new text or artifact as a derivative 
or secondary object in relation to the original text.” This lesson on noise 
and chip music itself is modeled after the deformative, hack-based praxis 
rooted in the chip music and related noise music communities. Parsing and 
breaking Attali’s text into creative scraps with the potential to germinate 
new systems, I believe, is a deformative act. Multiple students play with an 
Attali quote that articulates a historical homology between music and tech- 
nology: “Every code of music is rooted in the ideologies and technologies 
of its age, and at the same time produces them.”** Some students find a way 
to engage with Attali’s writing in their chip music composition. A few stu- 
dents recompose popular tunes from their own time (c. 2013) using sounds 
produced by the Game Boy chip music emulator to reflect the idea of age, to 
show the temporal disparity between the technological relic of the Game 
Boy and the tech of their present. Other students use even more abstract 
parts of Attali’s text to sonify the idea of noise as a means of materializing 
the relationship between music and human perceptions of chaos and noise. 
Deformative approaches to pedagogy have even greater implications for 
rethinking the role of creative assignments in humanities courses. I will 
reflect on this corollary in the final section of this chapter. 


Reflexivity 


Reflexivity describes a system that refers back to itself. It models the feed- 
back loop and embodies circularity. The concept of reflexivity has implica- 
tions in music studies, digital humanities, and media studies.” I offer eth- 
nomusicological insights on the relationship between reflexivity and the 
transmission of knowledge. In particular, I draw on Tomie Hahn’s work 
that looks at the transmission process of embodied knowledge in nihon 
buyo, Japanese traditional dance. She declares the critical positionality of 
her personal experience in her monograph: “Because nihon buyo has been a 
part of my life since childhood, it was a clear candidate for a case study on 
the transmission of cultural knowledge. I decided to write this ethnography 
with a reflexive voice because my body physically experiences and informs 
my perspective on transmission, and ignoring this voice would have been 
disingenuous.””° According to Hahn, the process of knowledge transmis- 
sion is central to ethnography. The researcher’s reflexive forms of knowl- 
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edge can be critical to grasping cultural knowledge through wrestling with 
the tension between self and other and through embodied, tacit ways of 
knowing. 

Learning is, in many ways, an exercise of research, a process of knowl- 
edge discovery and transmission. The reflexive framework offers a fruitful 
perspective regarding the purpose of learning. In institutional learning 
students often take for granted the value of learning. The product orienta- 
tion of learning becomes a barrier for students to realize the transformation 
potentials of knowledge. Learning something for oneself begins with the 
realization that the process of knowledge acquisition can be personalized. 
Learning can be a process of self-becoming, and knowledge acquisition 
is not an end goal but a process that can be meaningful in itself. Self- 
knowledge, as Hahn reminds us, can be a “resource within research.”** 
How can we reposition learning as something that’s more process-oriented? 
How can we rearticulate the purpose of learning? My answer to this question 
is a reflexive ethnographic final project that echoes Hahn’s ethnographic 
research framework. 

Dubbed Sounds of Learning, the culminating class assignment is a com- 
munity project that pairs college students with sixth graders from a nearby 
elementary school to coproduce a three-minute audio piece that documents 
and comments on youths’ experiences of school and learning. Based on a 
reflexive logic of learning about learning, this project extends classroom 
learning beyond the confines of a college to embrace broader notions of 
cultural and embodied learning in the community. Using a community- 
based, ethnographic paradigm, this project recodes learning by embedding 
students in sounded communities. The project explores, activates, and 
records the sonic dimensions of acquiring, mastering, and embodying new 
information, cultural knowledge (pop culture, heritage, language), social 
norms, and values (identity, status). I introduce this collaborative provoca- 
tion using the text below: 


We deliberately sound the process of learning by asking our sixth-grade 
collaborators to capture sounds that are meaningful to them. These 
might include the sounds of school activities and environment, con- 
versations with peers and adults, interactions with popular culture and 
media, sounds of home and neighborhood, and counting. In the most 
literal sense, the sounds of your interview with students of Annandale 
Elementary—what and how they articulate as their answers to your 
prompt questions—are sounds of learning in themselves. They reflect 
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how the sixth graders come into awareness of their surroundings. As im- 
portantly, these sounds teach you, the ethnographer, aspects of the social 
and aesthetic world that they live in.” 


During this collaboration, students enrolled in my course synthesize appro- 
priate techniques and ethics of ethnographic research and field recording 
that they acquired throughout the semester. Through a hands-on engage- 
ment, students reinforce their knowledge of another course premise, eth- 
nography as an embedded and sounded practice. 

In this model, recording is considered as a reflexive research practice that 
extends the technique and purpose of close listening. “Recording is itself 
a form of research. Of course it is important for a documentary producer 
to capture good sound, but getting any kind of recording is also a mode 
of exploration and investigation in its own right.””? In this project, I chal- 
lenge students to think beyond the expected content, form, and standards 
of recording quality of “sounds of learning.” Students should continue to 
reexamine their definition of learning, throughout the progression of the 
final project by working through destabilized notions of aesthetic worthi- 
ness and acceptability while interpreting field recordings. 

The digital making component of the Sounds of Learning class project 
evokes some of the technique that others refer to as critical making. Mat- 
thew Ratto ties critical making to the mission of synthesizing theoretical 
and pragmatic modes of engagement with knowledge that is often held sep- 
arate: “Critical thinking, typically understood as conceptually and linguis- 
tically based,” joins with “physical ‘making,’ goal-based material work.”** 
Deconstructing the recipe of how digital sound media are made via an act of 
remaking can afford students of both Occidental College and the partnered 
elementary school to gain an access to personal and reflexive meanings of 
technology in their everyday lives. This kind of critical making can also 
help recontextualize students’ relationship to technology, enabling them to 
question their expected role as technology consumers and end-users and 
engage with technology beyond the black box.” 


Resonance 


Sounding and listening are both relational and social activities. They bridge 
social rifts and forge new connections. They generate resonance and so- 
cial openness.” In a learning context, sounds can facilitate and encourage 
the exchange of information between multiple sounding agents, for exam- 
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ple, between the instructor and students, between students and their class- 
mates, between students and their extended peer and family networks. In 
this resonance framework, sounds can activate participatory learning and 
empower individuals with a voice to express themselves. Allowance of 
sounds and voices can flatten the social hierarchy of the agents in a class- 
room. Jesse Stommel shares Freire’s vision of “problem-posing education” 
as an alternative to the industrial banking model of education: “A classroom 
or learning environment becomes a space for asking questions—a space of 
cognition not information. Vertical (or hierarchical) relationships give way 
to more playful ones, in which students and teachers co-author together the 
parameters for their individual and collective learning.””” 

Sounds can be a medium of power for individuals to assert their agency. 
They enable the activation and emanation of voices, an articulation of differ- 
ence and plurality that can be heard by the participants and their audiences. 
A vocal enactment of plurality can undermine conventional classroom dy- 
namics and redefine the purpose of education. In what follows, I will draw 
from the Sounds of Learning final project to illustrate the affordance of 
sound as a catalyst to reorganize the traditional flow of communications 
related to teaching and learning. 

Occidental College straddles two neighborhoods in northeast Los An- 
geles: Eagle Rock and Highland Park. Though with slightly different social 
histories, both neighborhoods have been changing dramatically in terms of 
land and property values. The community discussion about gentrification 
and displacement (the dispelling of low-income renter-residents in the pre- 
viously predominately Latino neighborhoods) has become more polemical. 
My course took place in 2013, a time when signs began to show of neigh- 
borhood changes related to real estate and property development. From 
informal conversations with community organizers and the director of the 
college’s Center for Community-Based Learning, I gathered that a part- 
nership with the local elementary school would not be seen as politically 
neutral. Occidental College students have traditionally been uninvolved in 
activities in the broader community. This “campus bubble” and the social 
divide between the Occidental campus and the broader community is per- 
ceived as a reality by the community and, to an extent, by the students and 
faculty themselves. 

With a goal to create a shared experience based in colearning, I set out 
to intervene in the existing power relations between student participants 
at Occidental College and at Annandale Elementary School. In addition to 
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the age disparity between the college students and the sixth graders, other 
social factors mediate the ideas of difference between these two groups. 
Occidental is private liberal arts college. My students were mostly white, 
whereas the Annandale sixth graders were majority Latinx. While a sub- 
set of the Occidental students are first-generation college students, some 
of whom are on financial aid, the majority of the student body consists of 
students who come from socioeconomically privileged backgrounds. This 
project provided a platform for my students to conduct community-based 
research with an emphasis on researching with a community—in other 
words, observing and participating in the social lives of their sixth-grade 
research partners. 

This collective research model privileges the experiences and the episte- 
mology of the sixth graders, thus making the Occidental students assume 
the role of learners of the social world in which their elementary-school 
partners live. Sound is foregrounded as the medium of this unique learning 
journey while engaging with processes of knowledge transmission, specu- 
lation, and argumentation. At the kickoff meeting, which takes place at the 
elementary school, college students meet and teach their sixth-grade part- 
ners the basic techniques of field recording. Sixth-grade students then take 
recorders home with them with the goal of gathering recordings related to 
learning. During the field-recording period, a workshop is set up for sixth 
graders to share their recordings with their college student partners. They 
work together to coexplore the meanings of the recordings; based on the 
outcome of this exercise, they may restrategize their field-recording plans. 
Then college students meet during their class time to review ethical prin- 
ciples of ethnography and develop a set of interview guidelines.”* In a final 
digital-making workshop, college and sixth-grade students discuss, nego- 
tiate, and eventually come to an agreement on a shared production vision 
and plans for the final composition. Following their agreed plan, college 
students spend the final two weeks of the semester listening closely to the 
recorded materials while mixing and editing recordings into a composition. 
A listening party takes place inside the elementary school’s multipurpose 
auditorium at the end of the semester, bringing together sixth-grade stu- 
dents, teachers, family, college students, and administrative support staff 
of Annandale Elementary and the community-based learning center at 
Occidental College. Based on the feedback gathered at the listening party, 
college students revise the mixes and submit their final version along with 
a thousand-word blog post reflecting on the project in light of concepts 
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learned throughout the semester. The final mixes of the compositions are 
distributed back to the elementary school students with cover art and liner 
notes created by one of the Occidental students.”° 

For my students, the success of their projects is highly dependent on the 
recording products collected by their sixth-grade partners. Throughout 
my students’ workshop, I hear students complain that their sixth-grade 
partners did not collect adequate recordings. One student claims that his 
sixth-grade partner’s recordings of neighborhood streets are meaningless 
in the context of the assignment. I take these complaints as opportunities 
to push my students to listen harder and think critically about their own as- 
sumptions about these sounds and their partners. I pose questions such as: 
Do you hear sounds like this in the neighborhood where you grew up? If not, 
how do you make sense of this difference given what you know about their 
social world? These inquiries ultimately lead students to interrogate their 
processes of knowledge production and assumption formation within the 
project’s social specifics and to expand what they consider to be legitimate 
knowledge. 

Throughout the project, my students are encouraged to forma dialectical 
relationship with the sound of learning accomplished by, to use a metaphor 
introduced earlier in this chapter, the encoding and decoding of culture. 
The acts of encoding and decoding cultural materials—specifically, mak- 
ing, remixing, and composing with field recordings—constitute the core 
of learning, the acquisition of knowledge. Through recording, mixing, and 
composing, students listen thoughtfully and kinesthetically across barri- 
ers of education, class, age, gender, and ethnicity. And the bidirectional 
relationship with research associates achieved through shared listening 
and making help cultivate empathy, a desirable quality that emerges from 
reflections of ethics and critical positionality in ethnographic research. One 
student articulates this outcome in his final reflection essay: 


My partner, Anthony, was very humble at first, but later opened up to 
me during his visit to Occidental College. I did not understand the world 
he inhabits as he described when we first met. While he did his best to 
paint a picture in my head, I could not get a clear image without a sonic 
environment. It was only after I listened to his recordings that I was able 
to visualize a picture of his world. . . . I originally thought of a school 
setting, but through my interview with Anthony, I began to think with a 
wider perspective and settled on focusing on his life at home. Learning 
is not only math and science, but also life lessons and growing up. An- 
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thony shared with me that his parents were divorced and he did not really 
have a place where he can call a permanent residence. Home is a place of 
learning because that is where someone grows up and develops personal- 
ity. Even though Anthony lives in different homes at different times with 
mom and dad, he felt that both places were his home. I was really grateful 
that Anthony was able to open up to me and talk about his family. I made 
a lot of effort to engage in casual conversation to make him feel comfort- 
able to just talk story and not pay attention to the recorder. In the end, he 
told me jokes about pranks that his family members did to each other. He 
even shared that his dream is to become a Marine just like all the men in 
his family. He asked me questions about what college life is like and other 
things that are not particularly relevant to the music project. Just like 
John and Alan Lomax were able to do field recordings across the country 
by engaging in conversation and being friendly, I was able to do the same. 
The Annadale project taught me a lot more than I expected about myself 
and opened my ears to perceive a sonic world.*° 


This student’s reflective excerpt begins with an assumption that learning 
takes place in school, but through conversations with his partner Anthony 
and listening to his partner’s recordings, he is able to theorize more broadly 
about the meaning of social learning in his partner’s life. The student au- 
thor (who self identifies as idanxfi) is an international student from Japan. 
Listening to his Latino research partner across the ethnic and national lines 
ended up being a lesson about his own ethnic difference in relation to his 
partner. His reference to John and Alan Lomax hints at a deeper interro- 
gation of the racialized relationship and economics of exchange between 
those who recorded (white, Anglo-Saxon) and those who were recorded 
(nonwhite, often black and Hispanic) in the history of folklore, an ongoing 
conversation throughout the term of the course. This excerpt illustrates that 
collective listening and digital making constitute a shared communication 
platform. Using this platform, student researchers may iterate the research 
cycle of listening to, speculating about, and making the meaning of sound 
while interviewing their research partners until they attain a deepened un- 
derstanding of culture. This model exemplifies the multimodality of learn- 
ing by sonifying the often inaudible learning spaces and processes by break- 
ing down place-based conventions of learning, in this case school vs. home. 

Colistening and comaking also question the subject-object binary that 
dates back to historical colonial research practices. “The Annandale project 
taught me a lot more than I expected about myself and opened my ears to 
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perceive a sonic world.”** This has particular ramifications for Occidental 
College, a small, elite liberal arts college tucked in a semiurban pocket of 
metropolitan Los Angeles. The collaborative media-making process fulfills 
the mission of learning as a form of community engagement. Reducing the 
distance between subject and object of ethnographic research, critical and 
collaborative making encourages listening with empathy and communicat- 
ing across differences. 

For the sixth graders, this project serves as more than a technical arts 
workshop. It is intended to spark reflection and empowerment on a new- 
found understanding of their everyday cultural and environmental sound- 
scapes, a discovery about how sounded environments have shaped their 
sense of place and self throughout their elementary school years. To this 
point about self-realization, CJ’s project with Jazmine comes to mind. Over 
initial interactions, CJ learns that Jazmine is shy and uncomfortable with 
recording her voice. Turning this obstacle into an opportunity to forge a 
connection, CJ repositions his role relative to his research partner. He re- 
counts this moment in his reflective blog post: “This project became more 
than just a way to get a good grade in the class, but rather an opportunity 
to shape someone’s life. My role moved away from mentor, interviewer, and 
ethnographer into cheerleader, motivator, and empowerer.”** Jazmine is an 
aspiring singer but refuses to sing in the presence of CJ. As a response, CJ, 
who is also a singer, encourages Jazmine to explore her voice through self- 
recording and operate the recorder herself as a means to take control of her 
own recording. CJ writes in his reflection paper: 


She became a different person, and the recorder transformed from merely 
a sound-capturing tool to a microphone of a singer. The recorder became 
a tool of transformation, a means to express identity, a source of empow- 
erment. Though I had to walk away, once she was in her zen moment and 
alone, she allowed her soul to sing. The transformation was amazing.” 


CJ is highly aware of the representational politics of field recording and sam- 
pling, a topic of class discussions earlier in the semester. His relinquishing 
the control over recording shifts the typical dynamic of an ethnographic 
relationship. Teaching while empowering his partner Jazmine to record her 
own voice ends up bolstering the research associate’s courage to take agency 
in staking a claim to her own representation. 

In this instance, recording acts as an empowerment tool that disrupts the 
colonial and historical object-based thinking about documenting the cul- 
tural other. Recording has been reclaimed by the ethnographic subject, who 
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not only uses technology to amplify her own voice but also acquires a trans- 
formed perspective about herself and her relationship to her own voice and 
embodied subjectivity. As a resonating medium between the ethnographic 
researcher and the research associate, sound enables the transformation 
of the directionality of knowledge transmission. It offers opportunities for 
both CJ and Jazmine to experience reflexive learning on their own terms and 
to play an active role in knowledge creation. 

After Jazmine comes back with her recordings, she and CJ agree to make a 
“cool remix.” With this self-critical awareness, CJ creates an audio narrative 
entitled “Blooming Flower.” Interweaving the story with Jazmine’s record- 
ings of her own vocal explorations, CJ experiments with audio storytelling 
techniques that portray his partner’s “finding identity and power.”** The 
process and product of CJ’s audio work support the affective and intellec- 
tual growth of his research partner’s life. His thoughtfulness leads him to 
nuance a multimodal argumentation style that simultaneously critiques the 
medium and politics of ethnographic representation and builds a relation- 
ship with his research partner. 


Final Reflection 


Sounds are messy. They travel, leak, and cut through barriers that are os- 
tensibly prohibitive. This makes sound a great medium to discover new 
paths for intellectual inquiry and practice. Sounds create opportunities to 
interrupt the existing logics in institutional learning. When I teach, I use 
these creative opportunities to reencode the meaning of learning. The most 
successful instances all call into question the product-focused approaches 
to learning. These teaching experiments require that I partially relinquish 
my control as an instructor to define what’s meaningful in students’ learn- 
ing experience. Letting go of this impulse to script the purpose of learning 
means giving students their agency to determine their own relationships to 
their objects of inquiry. It also means that instead of meaning and purpose, I 
provide them with a scaffold to explore the web of scholarly knowledge with 
their own voices and positions. Reprogramming pedagogy in many ways 
means unprogramming some of the top-down command by the instructor. 
A thoughtful rescripting brings to life a dynamic learning algorithm that is 
reflexive, process-oriented, and participatory with student input. 

Much of my effort in redesigning teaching goes into reconfiguring the 
relationship between reading and writing, listening and reflecting. “Break- 
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ing” text-based traditions in learning and using the deformative metaphor 
through sonifying can not only destabilize textual knowledge but also lead 
to unexpected learning results.” These sonifying interventions enable 
students to play and experiment with intellectual materials within a new 
space, one in which creativity plays a central role in learning. My intention 
for students to construct a sounded document—a new sonic artifact that by 
its existence has little respect for the original scholarly text—is to disrupt 
the fun vs. serious binary in university learning. Often in a university class- 
room, creative projects are relegated to a secondary place, treated as “fun” 
for extra credit or as a supplement to a more serious assignment like an 
essay. To a large extent the rigor of evaluating these creative works is under- 
developed in humanities courses because of the myth that creative work has 
no relationship with “serious” scholarly materials. My current articulation 
of the relevance of creative projects in humanities coursework hopefully 
contributes to the larger pedagogical conversation about the educational 
value in having students engage with multiple modalities of learning as they 
grapple with sometimes complex and esoteric scholarly content. 

A few of these teaching experiments fail, however, as experiments do 
sometimes. One reason is students’ lack of openness to try something 
different. Some students in my class had a hard time thinking outside the 
box. Many of them are first-year college students with habits of learning 
established in secondary education. Only a subset of students understood, 
for instance, the instructions provided for the chip music assignment and 
found a way to link their reading responses to their compositions. This 
could be because students are not used to engaging in creative practice in 
humanities courses and are often discouraged from tempering learning 
with subjective meanings such as affect, stories, and creativity. Within the 
course context, it may be useful to demonstrate this assignment by eliciting 
examples that explicate a link between intellectual and creative grappling 
with text, and doing so within the context of a transparent grading rubric. 

While it is easy to assume that some students are “naturally” more 
creative than others, we as instructors need to be mindful of the effects of 
nontraditional learning engagements on students of various backgrounds. 
I notice that students from less privileged backgrounds are less likely to 
engage with learning experiments. What seems to me like a healthy chal- 
lenge could end up being perceived as a stigma or being negatively tied to 
previous experiences of learning. Teaching interventions should be imple- 
mented with sensitivity toward the cultural and social needs of students and 
responsiveness toward the history of learning that each student brings. 
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Last, I want to return to C)’s story to offer a final comment. In his final 
reflection essay, CJ notes a resounding contradiction between the evaluative 
and transformative aspects of learning. “This project became more than just 
a way to get a good grade in the class, but rather an opportunity to shape 
someone’s life.”** How do we reconcile between the holistic mission of 
sounded learning and the competition-ridden assessment requirement of 
education? 

Earlier in the chapter I spoke of how grading and evaluation rank the per- 
formance of student work. It seems strange that I critiqued this pedagogical 
practice but then do not examine it in the rest of the essay. While students 
and instructors may experiment with the meaning, media, and modality 
of learning within the context of a course, most of these practices are still 
fixed within the larger grade-oriented gridlock. While I apply the concept 
of resonance to reorganize the communication flow between student re- 
searchers and their ethnographic research associates, my relationship with 
my students remains status quo. I offer workshops and invite guest speak- 
ers into the course, but ultimately I still run the show. It is my course and 
I am still the authority as the instructor. What a conundrum. If given the 
opportunity, I would extend my reprogramming efforts into the realm of 
evaluation by considering alternatives such as a “contract grading” policy 
to offset the compulsory “transformation of a complicated, nuanced, and 
(ideally) supportive relationship into a mercenary transaction.”*” 

The experiments that I have evoked in this chapter give fodder for 
thought. I hope to inspire further experimentation and iterations that come 
with the sharing of practices and the embracing of failures. Efforts to re- 
program teaching and learning should happen at both the course and cur- 
ricular levels. For a sustained impact, let us continue to imagine thoughtful 
and creative efforts that sonify acts of knowing and resonate transformative 
visions of learning. 


NOTES 


1 Winter et al., History of Civilizations. 

2 The sonic politics of learning have class implications in earlier formations of 
social stratifications in the United States. Citing Cavicchi, Silva-Ford links the 
hierarchies of sound and silence encoded in learning to nineteenth-century 
ideologies that define class distinctions. Quiet behaviors of learning and read- 
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ing exemplify middle-class respectability. The quietude of reading and listen- 
ing elevates the status of genteel people, setting them apart from the noisy 
pastimes of slaves, immigrants, and workers. Cavicchi, Listening and Longing, 
52, cited by Silva-Ford, “Sounds of Writing and Learning.” 

See Freire, Pedagogy of the Oppressed. For a historical overview of the industrial 
model of education and the critical potentials of digital pedagogy, see David- 
son, Now You See It. 

Emphasis on writing, Silva-Ford notes, stems from the association of writing 
with linear organization of ideas and print-based media (“Sounds of Writing 
and Learning”). Within this design paradigm, forms of student work that are 
not print-based, linear expressions of arguments—including audiovisual, 
interactive, networked, and born-digital—are undervalued. It is worth noting 
that this perspective reduces the interactive potentials of textual engagements. 
The Digital Music-Cultures course provides a critical and hands-on envi- 
ronment for students to explore how current music as “digital vernacular” 
differs from its analog, historical counterparts; how contemporary digital 
music-cultures create new meanings of place and identity in the increasingly 
globalized world; and how social, media, and technological institutions or- 
ganize twenty-first-century music participation at the dispersed, grassroots 
level. To learn more about the course, see the course site introduction at 
http://cdlrsandbox.org/wordpress/digitalmusiccultures. 

Bolter and Grusin, Remediation. 

Novak, “Sublime Frequencies.” 

Drucker, “Performative Materiality”; Kirschenbam, Mechanisms. 

Hsu, “Digital Ethnography”; McPherson, “Introduction: Media Studies”; 
Nowviskie, “Resistance in Materials.” 

On textual materials, see Moretti, Graphs, Maps, Trees; on sonic materials, see 
Clement et al., “Sounding for Meaning.” 

I have discussed the instructions and outcomes of this sounded writing as- 
signment in a blog post. See http://cdlrsandbox.org/wordpress/racegenderpop/ 
student-projects/musical-autobiography (accessed January 14, 2018). 

The prompts in the assignment include: Which quotations in the Attali read- 
ing “exemplify or reflect an ideology (related to music, society, consumption, 
or technology) expressed by participants of the chip music community; 
demonstrate a technological or musical practice seen in the chip music 
community; differ from or challenge how music (or noise) is understood in 
the chip music community; explain or encapsulate the meaning of chip music 
in a particular social context?” 

The instructions for this in-class activity, along with the shared document 
created by the students, are posted on the course site: see http://cdlrsandbox 
.org/wordpress/digitalmusiccultures/lessons/week-7 (accessed January 14, 
2018). 

The actual instructions used for this assignment are posted on the course 
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site: see http://cdlrsandbox.org/wordpress/digitalmusiccultures/assignments/ 
assignment-7 (accessed January 14, 2018). 

Gann and Samuels, “Deformance and Interpretation.” 

Sample, “Notes toward a Deformed Humanities.” 

Sample, “Notes toward a Deformed Humanities.” 

Attali, “Noise,” 37, in Sterne, Sound Studies Reader. 

Wayne Marshall’s work claiming mashup as a pedagogical practice touches on 
the idea of media production as a reflexive pedagogy. Marshall’s formulation 
seems promising because it positions digital (music) making as a critical 
practice, one that highlights a self-conscious engagement with the makers’ 
personal reactions to the musical components of a mashup composition. 
Unfortunately Marshall’s theorization falls short on its implications for class- 
room learning. His definition of pedagogy assumes a broad understanding of 
pedagogy as a transmission of knowledge between performers and audience 
and by extension, between scholars. See Marshall, “Mashup Poetics.” 

I should note that reflexivity has surfaced in digital humanities as a part of 
the theorization of virtuality and human-machine interface (Hayles, How We 
Became Posthuman and Electronic Literature) as well as cultural rhetorics (Sano- 
Franchini, “Cultural Rhetorics”). A related concept of recursivity has been 
tied to the discourse about the public within the open-source community in 
anthropological literature (Kelty, Two Bits). These references, however, do 
not engage with the process of knowledge transmission in the social and 
sensory realms in ways that would be productive for a discussion about sound 
pedagogy. 

Hahn, Sensational Knowledge, 10. 

Hahn, Sensational Knowledge, 10. 

Hsu, “Digital Ethnography.” 

Makagon and Neuman, Recording Culture, 15. 

Ratto, “Critical Making,” 253. 

Balsamo, “Videos and Frameworks,” cited in Sayers, “Tinker-Centric Peda- 
gogy,” 282; Latour, Pandora’s Hope. 

Low and Sonntag, “Towards a Pedagogy of Listening.” 

Stommel, “Critical Pedagogy.” 

The prompt for this workshop session is posted on the course site: see 
http://cdlrsandbox.org/wordpress/digitalmusiccultures/workshops/ 
annandale-workshop-1 (accessed January 14, 2018). 

The reflective assignment prompt is posted on the course site: see http:// 
cdlrsandbox.org/wordpress/digitalmusiccultures/assignments/final-project- 
assignment (accessed January 14, 2018). 

idanxfi, “Sounds of Learning.” 

idanxfi, “Sounds of Learning.” 

Siege, “Blooming Flowers.” 

Siege, “Blooming Flowers.” 
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34 Siege, “Blooming Flowers.” 

35 Sample, “Notes toward a Deformed Humanities.” 

36 Siege, “Blooming Flowers.” 

37 Posner, Selfies, Snapchat, and Cyberbullies. Posner states the rationale for her 
contract grading policy on her course website. See http://miriamposner.com/ 
dhr5ow15/contract-grading (accessed January 14, 2018). For more on contract 
grading, see Danielewicz and Elbow, “Unilateral Grading Contract.” 
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Now accessing audio online seems easy. We find what we want to listen to 
through Google or through a search box on a favorite site. We can click ona 
link, open the file right in the browser, and then press play, fast-forward, and 
playback. In some cases, we can even view the sound waves or spectrograms 
associated with the audio or we can annotate what we hear and remix these 
representations. At the same time, modes of computational analysis with 
sound that let us search for sounds with sound or map sonic patterns across 
collections of audio, for example, remain few and relatively simplistic. 

The editors of this collection have rightly asserted that digital sound 
studies must include technology as an object of study in order to attend to 
“the ways that various devices mediate sound, from the speaker and mi- 
crophones to software coding and hardware development” (introduction). 
Using technologies to enhance access to and analysis of audio collections 
seems to promise a wide range of critical “close” and “distant” critical lis- 
tening opportunities in digital sound studies, but there are still few conver- 


sations about the many ways in which digital infrastructure technologies, 
or the hardware and software that facilitate these methods, influence schol- 
arship. * To better understand these mediations in the context of developing 
tools for critical listening, this chapter considers classification systems for 
sound as a significant object of study for better understanding the digital 
infrastructure technologies that facilitate scholarship with audio. 

Technologies used to facilitate scholarship with audio require a classifi- 
cation system to “mark” or annotate features of digital audio or text so that 
we can organize and search them more easily. By limiting the computer’s 
search to identifying keywords or concepts such as an author name, a date 
range, or a genre (like horror or comedy, for example), we get expected re- 
sults more quickly. Though they often seem invisible in the digital realm, 
classification systems reflect how we interact with machines as social and 
situated beings. Classification systems are subjective and deeply political: 
one person’s horror movie could be another’s comedy. 

Classification or standardization protocols are subjective and political 
because they are sociotechnical phenomena—pertaining to both human 
and technical influences. A sociotechnical perspective sees technologies 
as “ways of life, social orders, practices of visualization” that are interde- 
pendent with the politics of knowledge production.” From this perspective 
comes the understanding that the classification standards we develop, which 
ultimately shape the knowledge produced through them and by them, are 
developed according to our own perceptions of the world.? So, while we need 
standardized protocols such as classification systems to make our hardware 
and software work more efficiently for everyone, we also need to learn how 
to interrogate these systems in order to understand how our assumptions 
and biases impact the knowledge we produce with these technologies. 

To frame this study from a sociotechnical perspective and within the par- 
ticularities of digital sound studies, this chapter considers a specific digital 
humanities project in sound—High Performance Sound Technologies for 
Access and Scholarship (HiPSTAS)—and a particular aspect of development 
within that project—the use of standardized classifications for describing 
sound features within the development of a tool for searching sound with 
sound.‘ Situating this aspect of development within HiPSTAS within a brief 
history of methods for classifying sound features will help us consider the 
impact that technology and politics can have in shaping scholarship in dig- 
ital sound studies. 
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Sound in the HiPSTAS Project 


A joint project of the School of Information at the University of Texas at 
Austin and the Illinois Informatics Institute at the University of Illinois at 
Urbana-Champaign, HiPSTAS was initially funded by the National Endow- 
ment for the Humanities as an Institute in Advanced Technologies in the 
Digital Humanities. * The HiPSTAS Institute included twenty junior and se- 
nior faculty and advanced graduate students as well as librarians and archi- 
vists in the humanities from across the U.S. interested in analyzing large 
collections of spoken-word audio collections using high-performance or 
“supercomputing” technologies. Among many collections of interest to the 
participants were 30,000 files of recordings from PennSound’s poetry ar- 
chive; 600,000 digital collections objects from the American Folklife Center 
at the Library of Congress; 30,000 hours of oral histories from StoryCorps; 
and 3,000 hours in the American Philosophical Society’s Native American 
Collection, which includes recordings from more than fifty tribes across 
North America, among other collections. The participants met in two face- 
to-face meetings in May 2013 and May 2014 as well as in monthly virtual 
meetings. The objectives of the HiPSTAS Institute were threefold: first, to 
assess how these communities wanted to use computational tools to study 
spoken-word collections; second, to assess how those tools needed to be 
developed to support analyzing and visualizing large audio collections in 
the humanities; and third, to produce preliminary results with these tools 
using the collections of interest to the participants. 

A significant aspect of the HiPSTAS Institute included introducing the 
participants to the Adaptive Recognition with Layered Optimization (ARLO) 
software. ARLO, which was originally developed by HiPSTAS co-PI David 
Tcheng for acoustic studies in animal behavior and ecology, had previously 
been used to search for bird calls across field recordings. Conceived to 
model a bank of hairs in the inner ear, which vibrate at different audio fre- 
quencies in response to sound waves, ARLO monitors and then samples each 
“hair’s” instantaneous energy (a sum of the tuning fork’s potential energy 
or the deflection of the fork and its kinetic energy based on the speed of the 
movement, per second). ARLO uses this data to create a 2D matrix of values 
(frequency vs. time) called a spectrogram. Essentially, these spectrograms 
(see fig. 7.1) show a map of sonic energy across time: each row of pixels rep- 
resents a frequency band, and the color of each pixel represents the numeric 
value of total energy of that particular frequency (or how much the tuning 
fork trembles) for that point in time. ARLO uses these spectrograms to ex- 
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tract sonic features for machine-learning processes, including unsupervised 
learning such as clustering as well as supervised learning for classification.° 

Used to search across sound collections for sonic patterns, these 
machine-learning processes rely on human intervention. To teach the soft- 
ware to identify sounds of interest with supervised learning techniques, 
human “experts” annotate the sounds they want to find and use these seed 
examples to teach an algorithm to find other, similar sounds. With unsuper- 
vised techniques, the “expert” still chooses certain features of the audio to 
guide how the machine-generated clusters are formed. Thus, software like 
ARLO finds sounds by comparing each training example to new, unlabeled 
examples and determining good matches as those that seem to have some 
of the same features, such as the total energy value described above. For 
the ornithologist who is examining thousands of hours of birdcalls, this 
process of matching might mean marking (or “tagging”) examples of a 
particular bird’s call on a spectrogram and asking the software to retrieve 
similar calls. In the case of a humanist, such as one of the scholars at the 
HiPSTAS Institute, this could mean tagging moments of laughter, applause, 
gunshots, or feedback noise to teach the machine to find more such events. 
In each case, the machine is taught with these seed examples to find or clus- 
ter what the expert has marked as interesting. 

Machine-learning software like ARLO relies on many seed examples to 
train the algorithm. Consequently, realizing that the participants could 
produce more and possibly better seed examples if they worked together or 
with students, we developed a collaborative interface for tagging example 
sounds. Figure 7.1 shows the tagging interface we created for participants 
interested in analyzing the PennSound poetry archive.’ The interface pro- 
vides the listener with a two-second sample that has been randomly selected 
from PennSound’s approximately 5,500 hours of audio. The listener chooses 
labels to apply to the sample and then receives the next example. In this way, 
the listener can easily and quickly “mark up” a collection with examples for 
machine learning. 

The most significant aspect of this example for this discussion concerns 
how we chose the labels we used in the tagging interface. The tagging inter- 
face reflects a classification schema or set of rules that the PennSound poets 
and scholars chose for labeling the sound snippets.* They chose the clas- 
sification schema, found in the “Transcriptions of Speech” section of the 
Text Encoding Initiative (TEI) P5 Guidelines for Electronic Text Encoding 
and Interchange, for conceptual and practical reasons. First, they chose this 
schema because they wanted classifications that reflected the patterns they 
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Note: Plot Settings are controlled by the TagView settings in UserSettings. 
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FIGURE 7.1 A tagging interface used to classify sound features on examples from 
PennSound. 


sought to discover in their collection. In particular, the poets and scholars 
analyzing the PennSound collection were interested in analyzing the “vocal 
gestures” that Charles Bernstein (PennSound codirector) has argued “are 
available on tape but not page” and “are of special significance for poetry”: 
namely clusters “of rhythm and tempo (including word duration)” and “of 
pitch and intonation (including amplitude), timbre, and accent.”° By using 
descriptors from the TEI Transcription for Speech guidelines, the Penn- 
Sound participants believed they had found terms that accurately described 
what they were hearing and what they wanted to find. 

Second, the PennSound participants wanted a classification schema or 
standard that had been vetted by peers and that held the promise of facili- 
tating future collaborations among projects that had already used (or might 
in the future use) these classifications. Released in November 2007, TEI P5 
is a broad set of guidelines for an XML schema that is in wide circulation in 
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the digital humanities community. By using the TEI labels or schema, the 
PennSound participants hoped to create a set of descriptors that they might 
someday be able to use to compare classifications across PennSound and 
other audio collections. 

The goal was to use the TEI classification schema to facilitate many uni- 
form examples to train the machine-learning algorithm. Given a collection 
of two-second examples to tag, however, the thirteen participants assigned 
dramatically different tags to the same sample. One participant, for in- 
stance, might mark the same two-second sample “Beatable” with a “High” 
pitch and another might classify it as “Arrhythmic” with a “Low” pitch. 
Another issue arose when participants wanted to label contexts rather than 
snippets; they wanted more than the two-second window they were given by 
ARLO, and they wanted to tag the recording scenario (such as the sound of 
the room), the gender of the speaker, and the genre (such as music) as they 
perceived it, not according to the specified genre types that were provided 
by the TEI classification schema. That is, they wanted to label the label as it 
reflected their own listening perspectives, which were couched in complex 
understandings of culture, genre, and materiality, but our ARLO tagging 
interface, built using the TEI schema, would not allow them to do that. 

Using this defined vocabulary or schema, which was meant to facilitate 
the process by providing uniformity across the examples, the PennSound 
participants debated how and when to implement the classifications. The 
PennSound participants struggled with labeling what they saw on the spec- 
trograms, often citing doubts about their ratings and their understandings 
of the classifications and especially showing a resistance to the TEI classi- 
fication system they had chosen to use. While classifying snippets of sound 
seemed to work well for the ornithologist, classifying snippets of poetry 
performances according to the chosen standard seemed to frustrate the 
humanist’s desire to find dynamic or time-based aspects of performance. 
It seemed that while the sound of a bird could more easily be classified 
as “male cardinal,” classifying or defining the human voice—an act that 
Jonathon Sterne calls a debate over “what it means to be human”—was a 
more provocative endeavor.” Realizing on the one hand that the classifi- 
cation system was necessary for increased computational productivity and 
efficiency but also, on the other hand, that it was flawed in its orientation, 
the PennSound participants did not seek to discard the use ofa classification 
system but rather cited the need for a “better” (i.e., more accurate) classifica- 
tion system for describing sonic features as a high-priority requirement for 
moving ahead with developing ARLO. 
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I tell this story because it provokes sociotechnical questions for digital 
sound studies in general. How can aclassification system, which is an infra- 
structural mainstay for facilitating computational analysis, mediate knowl- 
edge production? And how can we study these mediations? Bowker and Star 
suggest “infrastructural inversions” as a method for better understanding 
these interdependences between standardizations and knowledge produc- 
tion.” As the authors suggest, we must take into account that standardized 
classifications and systems are ubiquitous; they are both materially and 
symbolically realized as well as historically situated, representing multiple 
voices and silences.” Ultimately, classification systems reflect philosophies 
concerning the nature of sound as well as the practical politics involved in 
developing such standards that include what remains visible and invisible 
in the system.” In my example above, we see an example of how a classifi- 
cation system might work in a tool like ARLO. The next two sections con- 
sider the historic roots of this system to better understand why they might 
have seemed inaccurate or inappropriate to the PennSound scholars. In 
particular, I will consider the symbolic and material underpinnings of the 
TETs Transcriptions of Speech classifications for sound within the history 
of philosophies in linguistics and the immediate political contexts that 
affected the establishment of these standardized rules. 


A Brief Look at Prosodic and Paralinguistic Classifications 


Linguists have been at the forefront of establishing complex and standard- 
ized protocols for describing spoken language. Driven by the desire to 
address the “practical needs of spoken language corpora annotation and 
analysis,” especially in the light of more recent developments in computer- 
facilitated speech analysis, Maciej Karpinski outlines seventy-five years of 
research in linguistics concerning attempts to define and categorize what 
we say and how we say it.* In a specific example that is of particular use for 
this discussion, linguists often use “prosody” as a phenomenon compris- 
ing varying degrees of intonation, stress, and rhythm that convey meaning 
through phrasing and prominence, while they describe paralinguistic fea- 
tures as those that do not easily belong to a describable linguistic struc- 
ture.*® David Crystal and Randolph Quirk divide their seminal study Systems 
of Prosodic and Paralinguistic Features in English (1964) into prosodic and para- 
linguistic features based on how easily these features might be integrated 
into typical linguistic structures. 
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Specifically, Karpiński claims that prosody may be measured or described 
using three basic parameters—pitch frequency, duration, and intensity— 
and that these parameters influence each other as communicating fea- 
tures.’° In written texts, prosodic features are typically described in terms 
of syntactical units. These language features often include parts of speech, 
accent, phoneme, stress, and tone as well as other information that influ- 
ences how a sentence can be read such as the position of a word in a phrase 
(e.g., consecutive verbs or multiple nouns), sentence type (e.g., a declaration 
or a question), and information structure (e.g., independent versus depen- 
dent clauses, since inferable information in a dependent clause is usually 
deaccented).”’ In other words, when we seek to “sound out” a written word, 
we guess how to pronounce words unknown to us based on our experiences 
with prosodic features such as recognizable clues for pronunciation in the 
surrounding syntax. Nouns in a series require different amounts of stress, 
for instance, and questions have a lilt. 

In comparison, paralinguistic features seem more difficult to describe 
and standardize. In his attempt to delineate terms, for example, Karpiński 
discusses paralinguistics within the context of three areas of study that in- 
clude prosody, vocal quality, and gesture.** Also referred to as timbre, voice 
quality in musical instruments connotes the distinctive sound a particular 
instrument makes in contrast to another—such as the sound of an oboe 
versus that of a tuba—even when the instruments are playing the same note 
at a similar amplitude. For Karpinski, such vocal features are “individual, 
idiosyncratic, and further from ‘language proper’” than prosodic features, 
making them “multidimensional and difficult to operationalize.” * Crystal 
and Quirk also note the difficult and slippery nature of categorizing para- 
linguistic vocal qualities that surround such sounds as giggling, laughing, 
and crying: 


It is not possible to say when giggle ends and laugh begins, or when cry 
ends and sob begins, though doubtless it would be possible to examine 
a great quantity of data and obtain some measurements (of pulse speed, 
air pressure, prominence, for example) which would be of value in estab- 
lishing more objective gradations.”° 


It is useful to note that Crystal and Quirk, who have attempted to system- 
atize these voice-quality measures in Systems, put prosodic features on the 
more “describable” end of the classification continuum from prosodic to 
paralinguistic, even while they are quick to note that there is no sharp divi- 
sion between them. “It is doubtful,” they write about implementing a system 
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of vocal-quality categories, “whether the results would justify the time and 
ingenuity involved.” ” 

Certainly, how we perceive and make meaning with prosodic and para- 
linguistic features is a subjective activity. Dwight Bolinger asserts that 
intonation “is generally used to refer to the overall landscape, the wider ups 
and downs that show greater or lesser degrees of excitement, boredom, curi- 
osity, positiveness, etc.”?? Further, in its expansiveness, prosody can signify 
elements ofa speaker’s identity including affect and emotional engagement, 
age, cognitive process and development, ethnicity, gender, and region and 
has been used to study human behavior, culture, and society.”? For these rea- 
sons, Karpinski points out, prosodic and paralinguistic features are often 
considered “indexicals” since they seem to point to the context of a person 
or place.” Indeed, Karpiński describes paralinguistics such as laughter, 
giggles, gasps, pauses, hesitations, or coughs as “all the phenomena and 
features of a speaker’s behaviour that go beyond the (current) limits of 
systematic linguistic description but still influence the way his/her commu- 
nicational contribution is understood by his/her conversational partner.””° 

Tasked with submitting recommendations for the TEI’s Transcriptions of 
Speech section of the guidelines, then, the TEI Spoken Text Working Group 
(sTWG) relied on Crystal and Quirk’s Systems and its assertions that prosodic 
and paralinguistic features influence meaning-making with sound as a ba- 
sis for identifying which speech characteristics in recordings should be (and 
could be) marked in the guidelines.” This Crystal and Quirk perspective is 
reflected in TEI labels that include the following attributes: 


Tempo: Very Slow, Slow, Moderate, Fast, Very Fast 


Rhythm: Beatable (highly rhythmic), Moderate, and Arrhythmic (flat 
or ordinary speech) 


Loudness: Very Soft, Soft, Moderate, Loud, and Very Loud 
Pitch: Low, Middle, and High 


Tension: Slurred or Lax (for looser articulation), Very Precise or Tense 
(for pronounced articulation) 


Other classifications include Whisper, Breathy, Husky, Creaky, Fal- 
setto, Resonant, Unvoiced Laugh or Giggle, Voiced Laugh, Tremu- 
lous, Sobbing, Yawning, and Sighing. 


Notably, this list is not an exact reflection of Crystal and Quirk’s work, in 
which voice qualities, which include different modes (normal voice, whisper, 
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breathiness, huskiness, creak, falsetto, and resonance); and voice qualifica- 
tions, which ordinarily interrupt speech (laughter, giggling, tremulousness, 
sobbing, and crying) are considered separately.” In contrast, the TEI guide- 
lines foreground the similarities between voice qualities and qualifications 
by grouping them together in a list of “other” classifications. 

It is these voice-quality features, which are regarded by linguists as 
difficult to systematically categorize, that the HiPSTAS project participants 
found most compelling in their attempt to systematically annotate their 
spoken-word recordings. The voice quality or timbre aspects of paralin- 
guistics, which Bernstein calls the “poet’s aesthetic signature or acoustic 
mark,” are particularly important in studying poetry performances.** As 
an indexical property, they appear in a spoken poem or performance as “a 
technical feature that can be used to form or deform social distinctions and 
variations.””° Consequently, as mentioned, the PennSound scholars chose 
to adopt the TEI descriptors for philosophical reasons, because the terms, 
adopted from Crystal and Quirk, seemed to reflect their own concerns, but 
they also chose them for practical reasons, since they had been adopted by 
an authority (the TEI community) and seemed to promise some consistency 
across projects, authors, and poems of interest as well as offering future 
possibilities for collaboration with other projects using the TEI guidelines. 
The advantages that come with building such a system, however, belie not 
only practical concerns about the fact that marking up audio takes time 
and resources but also philosophical concerns as to the erasure of a long 
history of conversations about the subtle differences between voice quality 
and qualifications. 


Three Compromises for Classifying Sound 


Bowker and Star suggest a means by which we can better articulate the 
sociotechnical nature of classification systems. Defining such systems as 
“a rich set of negotiated compromises ranging from epistemology to data 
entry that are both available and transparent to communities of users,” they 
challenge scholars to make such compromises readily apparent for con- 
sideration.” A primary compromise of interest for digital sound studies is 
one the introduction to the TEI guidelines articulates well: “An electronic 
representation must strike a balance between the following two, partially 
conflicting, requirements: authenticity and computational tractability.”* 
Authenticity, in this sense, is subjective and corresponds to whether or not 
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a digital surrogate or representation seems “true” or accurate to a philos- 
ophy about or understanding of that phenomenon in the world. Computa- 
tional tractability is the extent to which that representation is computable or 
representable in the computational environment, which includes the soft- 
ware, the platform, the hardware, and the networks being used to consider 
that representation. Thus, a philosophical concern for what is authentic in 
a community of scholars such as digital sound studies scholars must be in 
constant conversation with practical concerns for what is computationally 
tractable in a digital environment. 

By learning to articulate the nature of these sometimes conflicting re- 
quirements (at once philosophical and practical), we are empowered in the 
digital sound studies community to impact how the systems used by the 
community are designed and implemented. Below, based on a close look at 
the history of how the paralinguistic voice qualities in TEI’s Transcriptions 
of Speech schema came to be, and a consideration of how the HiPSTAS 
participants attempted to apply these guidelines with the ARLO software, I 
have suggested three more general areas of compromise for consideration 
in digital sound studies. 


COMPROMISE #1: Moving from Text to Sound 


The first compromise for consideration is one that balances a desire for 
“user friendly apps” against a desire for applications or software that fully 
represent the subtle characteristics of a phenomenon. We are used to pol- 
ished and seemingly intuitive applications for searching, browsing, pub- 
lishing, and teaching with text, but applications for searching, browsing, 
publishing, and teaching with sound are emergent, developing, and often 
“buggy.” In such a context, we must consider the compromises inherent in 
choosing ease-of-use technologies over change-of-paradigm technologies. 

For example, when the TEI STWG was tasked with submitting recom- 
mendations for the TETs Transcriptions of Speech section of the guide- 
lines, they focused on guidelines for marking up text-based transcriptions 
of recordings rather than guidelines for the faithful representation of the 
recordings’ many sonic attributes.” This focus was the result of STWG’s 
perspective on prosodic and paralinguistic features as problematic, such 
as “speaker overlap, pauses, hesitations, repetitions, interruptions,” uncer- 
tainty, and context.” It is clear from citations in their extant working notes 
and drafts that the stwG were versed in the works of Svartvik and Quirk 
(“A Corpus of English Conversation”) and Tedlock (The Spoken Word) and 
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considered paralinguistic and prosodic sound features expressive; yet based 
on the need to make a hierarchical representation of text a main tenet of 
TEI, they found these time-based and overlapping sound dynamics—such 
as pitch, speed, and tone—impractical to represent. (Indeed, encoding for 
recorded speech was not included at all in the original TEI P1 guidelines.)** 
In short, the stwa’s theoretical or philosophical understanding of sound 
did not coordinate well with the means they had to express or represent this 
understanding. Notes from the working group’s 1991 meeting reflect the 
compromises they knew they were making: 


In a brief discussion on performative features such as pitch, speed and 
vocalisation, LB [Lou Burnard] asked if these could not be regarded as 
analogous to rendition in written texts and treated in a similar way. It 
was generally felt that it would be better to mark these using milestone 
tags such as <tag>pitch.change</tag>, <tag>speed.change</tag> etc. 


The stwe concluded that topics including “quasi vocal things such as 
laughter, quasi lexical things such as ‘mm,’ prosody, parallel and discon- 
tinuous segments, uncertainty of transcription, uncertainty in general” 
needed “considerable further work.”** And, these “quasi lexical things” re- 
main peripheral to the guidelines even today. 

This peripheral status is reflected materially in how these paralinguis- 
tic features are included in the TEI standards. The stwG relegated voice 
quality—paralinguistic characteristics such as pitch and speed, etc.—to 
a “shift” tag or element.” The “shift” element (<shift/>) is represented “as 
pairs of milestone tags marking positions of prominence. . . with the ‘end’ 
tag of the pair being replaced by a shift to normal.” The choice to use this 
kind of elementis significant, because <shift/> requires the encoder to mark 
dynamic sound attributes in the encoded transcript as shifts to and from a 
“normal” speaking mode (see fig. 7.2). 

Beyond assumptions about normativity that exist behind establishing 
a “normal” speaking mode, elements like the <shift/> are conceived as 
phenomena that happen in discrete moments of time. The <shift/> element 
occurs in one spot and marks specific points in a transcript, as if the dyna- 
mism of such sonic features could be pinpointed in time. Though the TEI 
guidelines are clear in the assertion that they are “not intended to support 
unmodified every variety of research undertaken upon spoken material 
now or in the future,” the stwe’s choice to show paralinguistic entities as 
“shifts” from a “normal” state and as discrete, “well-defined units” flies in 
the face of discussions by linguists such as Crystal, Quirk, and Karpiński, 
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<u> 

<shift feature="loud" new="£"/>Elizabeth 

</u> 

<u>Yes</u> 

<u> 

<shift feature="loud" new="normal"/>Come and try this <pause/> 
<shift feature="loud" new="ff"/>come on 

</u> 


FIGURE 7.2 An example of the “shift” element from the TEI P5 guidelines. 


who discuss the dynamic, subjective, and slippery nature of paralinguistic 
features. Indeed, the guidelines for these features were intended primarily 
for enabling the linguistic study of spoken text recordings as “a written or 
electronic representation of a stretch of speech which is treated for some 
purpose as a well-defined unit.” The material instantiation of these features 
in the <shift/> element shows how sound attributes become marginalized 
in computational infrastructures that focus on text and spoken language.“ 

Other, more recent projects for developing classification schemas for 
sound can help us imagine other compromises we must make in our at- 
tempts to balance our desire for the niceties of systems built for textual 
searches and our desire for new systems that better facilitate sonic search- 
ing. For example, the Federal Agencies Digitization Guidelines Initiative 
(FADGI) formed as a group in 2007 “to define common guidelines, meth- 
ods, and practices to digitize historical content in a sustainable manner.” 
FADGI’s metadata standard, “Embedded Metadata in Broadcast WAVE Files, 
Version 2,” describes sonic information that points to sound’s materiality, 
including signal chain specifics, sample rates, and bit depth. Further, other 
classification schemas proposed by the International Association of Sound 
and Audiovisual Archives (IASA) capture information concerning an audio 
file’s provenance and historical context such as the date and place of a re- 
cording. Even with these advancements, questions remain concerning the 
extent to which classifications such as FADGI’s help us better understand 
vocal gestures and whether narrative descriptions of soundscapes give us 
enough information about sonic histories. Ultimately, these standards are 
works in progress and the sociotechnical histories behind the development 
of these standards also reflect compromises, both philosophical and prac- 
tical, that organizations other than the TEI will make based on a desire to 
balance their situated understanding of sound, the perceived needs of the 
communities they serve, and the technologies they hope to employ in the 
service of these goals. 
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COMPROMISE #2: Moving from Fixed to Emergent Meanings 


Another compromise to consider in digital sound studies is one that weighs 
a desire to represent sounds as fixed in meaning against the difficult work of 
representing sounds as phenomena with emergent and multiple meanings. 
This is a significant compromise to address because any digital represen- 
tation of the experience of sound will need be, by nature, a reduction that 
nonetheless invites expansive thinking. 

Sound studies scholars in the humanities have been primarily interested 
in articulating sound culture in all ofits complexity rather than in simplified, 
linear, or atomistic terms. For instance, citing Jacques Derrida, Dennis Ted- 
lock dismisses “the entire science of linguistics, and in turn the mythologics 
(or large-scale structuralism) that has been built upon linguistics,” since 
such sciences and mythologics are “founded not upon a multidimensional 
apprehension of the multidimensional voice, but upon the unilinear writing 
of the smallest-scale articulations within the voice.”*? Michael Chion argues 
that a recorded artifact has fixity that is necessary for close listening since 
to perceive sonic traits, one must listen repeatedly to a recorded moment, 
but he dismisses the state of fixedness that a framework like a classification 
system would engage since within it sounds “acquire the status of veritable 
objects” and “physical data”; this fixed data, he asserts, is inauthentic since 
it does not represent what was actually heard within the real time of “pres- 
ence.”** Likewise, Bernstein notes that “systems of prosodic analysis” that 
regularize sound “break down before the sonic profession of reading: it’s as 
if ‘chaotic’ sound patterns are being measured by grid-oriented coordinates 
whose reliance on context-independent rations is inadequate.” + These state- 
ments reflect an understanding of sound in the humanities as an emergent 
phenomenon that is dynamic and in flux and that evolves and expands over 
time, constantly introducing ambiguity and uncertainty. As such, there 
is a clear resistance toward “fixing” sounds for better understanding of 
meaning-making processes.*° 

Reduction as a means of representation is unavoidable in a digital con- 
text, but there are choices that dictate the terms of these reductions. Most 
of the categorizations outlined above, for example, have been established 
from the perspective of linguistic study and, for the most part, in terms of 
creating transcriptions from audio files. In contrast, classification systems 
devised by poets may be designed to represent the differences between 
breathy or harsh voices; a system designed by historians may better show 
the sounds of a city venue; and one designed by Native Americans might 
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facilitate comparing the changing paces of elders’ stories. In each of these 
scenarios, one can imagine that certain sonic attributes are foregrounded 
based on the interests of a particular community. 

A compromise that helps us better engage the emergent nature of sound 
hermeneutics in digital space is a choice that may be quite productive in 
digital sound studies. For instance, Kenneth Sherwood cites fixed and dis- 
crete instances of repetition as perceptible signs of emergence that signify 
elaboration and versioning. Bernstein notes the signification of dynamic 
“performative gestures” such as emotional intensification, which can map 
to measurable changes in heightened and decreased sound frequencies 
and speed.” Likewise, Crystal and Quirk have identified measurements for 
establishing the emergent dynamics of voice qualifications as “objective 
gradations” by “setting up parameters for degrees of pulsation types, pul- 
sation speed, oral aspiration, nasal friction, air pressure, amplitudes and 
frequency of vocal cord vibration, and volume and tension of supraglottal 
cavities.”** These examples demonstrate that the dynamics of a voice—its 
increasing or decreasing pace, its tone changes over time—can be under- 
stood against different frames of reference that we may choose to position 
as “fixed” (such as the words of a poem) even as we understand them to be in 
flux. This choice against fixity can be forwarded by classifications that help 
us better articulate and understand the terms of fixity as choices.*? As such, 
sound as a phenomenon of emergence could be understood in terms of how 
itis represented as fixed. 


COMPROMISE #3: Moving from Discrete to Contextual 


A third compromise for consideration in digital sound studies entails bal- 
ancing the desire for representing sound as a discrete event in time with the 
difficult work needed for describing sound across particular time contexts. 
In the previous section, I argue that we must represent fixed points in the 
sonic event in order to study the emergences of meaning. We must also bet- 
ter understand how we represent these features in fixed moments of time. 
Repeated, elaborated, or intensified moments can be marked as discrete, 
for example, even as their significance is based on their relationships across 
time with other moments. By constellating fixed moments in relationship 
to each other and situating them as patterned contexts over time, then, we 
may do the difficult work that we must do to develop classification systems 
that use fixity as means for representing contextualization and emergence. 
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Current guidelines for describing the historical context of recordings 
can provide an example of such a compromise between fixed and fluid 
representations. The TEI, for instance, includes a “recording” element that 
allows the encoder to describe dates; times of day; statements of responsi- 
bility for authors, editors, producers, etc.; the recording equipment used; 
or whether a broadcast recording is the basis of the text being transcribed 
and described. As well, there is a provision for adding elements that also 
describe the “setting” of a recording and its “participants.” The FADGI 
guidelines contain these fields as well as the “bext chunk,” which holds 
data on the digitizing process (including the analog source recording), on 
the capture process, on information about the storage of the file, and on 
versions of the coding history related to the file itself.” In many cases, these 
are optional fields that remain empty even as this contextual information 
impacts how we perceive the relationships that are marked and ultimately 
what and how we hear. 

The choice to include this kind of contextual information reflects a desire 
to articulate design standards that do not just report on relationality but 
rather encode it. Innovative and productive work for representing relation- 
ality is already happening in the context of speech transcriptions. IASA 
recommends the Resource Description Framework (RDF), a World Wide 
Web Consortium (W3c) specification that allows humanists to describe 
relationships between objects on the web. Currently used by arc (Advanced 
Research Consortium), for example, to provide gateways and venues for 
peer-reviewing digital projects for a variety of disciplines in literary study, 
RDF facilitates searching and finding relationships across projects in 
Networked Infrastructure for Nineteenth-Century Electronic Scholarship 
(NINES), 18thConnect (focused on eighteenth-century scholarship), the 
Medieval Electronic Scholarly Alliance (MESA), Renaissance Knowledge 
Network (ReKN), and Modernist Networks (ModNets). Using RDF, the 
ARC infrastructure is powerful, because each of the ARC nodes has its own 
stand-alone interface, but all of the resources can be searched together 
through the arc catalog. A search on NINES can be modified to find objects 
from MESA, for example. While further work needs to be done to imagine 
an RDF schema that reflects relationships across sonic features of interest, 
using something like the ARC infrastructure for sound files could mean 
cross-searching that includes sound resources, too, which in turn would 
enable scholars to better collaborate on digital audio projects on a local and 
global scale across disciplines and interests. This kind of relationality is 
similarly the future of new International Image Interoperability Framework 
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(11F) guidelines for facilitating better access to audio collections through 
application programming interfaces (APIs). 

A clear next step is to build tools that facilitate the ability to act on en- 
coded relationality. Karpinski, for instance, proposes a “coherent approach” 
to linguistic data annotation that would take into account the indiscrete 
nature of speech prosody and voice-quality features.” Recommending that 
we treat these features as continua rather than categories, Karpinski argues 
that prosodic and paralinguistic features are multifunctional, multimodal, 
and multileveled, as well as both global and local; as such, he recommends 
implementing “sliders or joysticks for data input and to refrain from impos- 
ing any points on the scale, such as from a stable to a trembling voice, with 
all intermediate states possible.” ** Thomas Schmidt also suggests practical 
solutions for implementing varied perspectives on sound, such as bringing 
seven tools that are most commonly used by linguists for spoken language 
transcriptions—ANVIL, CLAN/CHAT, ELAN, EXMARaLDA Partitur-Editor, 
FOLKER, Praat, and Transcriber—to a common TEI schema.” Karpinski’s 
and Schmidt’s interventions suggest compromises that encompass the prac- 
tical issues related to a need for discrete categorizations, such as annota- 
tions for linguistic data or a TEI schema, with the need to represent relation- 
ships across perspectives from multiple communities in multiple contexts 
across time. 


Conclusion 


Classification schemas for sound are language-based: they are themselves 
texts that attempt—sometimes with frugal and other times with rich results 
—to describe the world of sound that is always beyond text, beyond a lis- 
tener, beyond one single snippet of a recording played back at one point in 
time. To approach the complexities that characterize our experiences with 
sound, there are many more philosophical and practical compromises we 
will have to negotiate as we continue to develop productive infrastructures 
for digital sound studies. We will need to consider what it means to engage 
sound thoughtfully, expansively, and critically with computational instru- 
ments that are often modeled on the normative practices of “hearing” with 
the ear when the ear is not the only hearing instrument. “I can hear more 
plainly through my teeth than through the external ear,” Thomas Edison 
admits; “A stick touching a music box and placed between my teeth enables 
me to enjoy the music.”** Another compromise will entail balancing well- 
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intentioned plans to incorporate crowd-sourced listener responses with the 
practical need for clean and manageable digital sound data. Tsur reminds 
us, for instance, that “sophisticated electronic instruments do give an accu- 
rate analysis of the sound information; but what really matters is its integra- 
tion as it takes place in the brain” of each listener." We must learn to balance 
this desired sophistication with the vast amount of data that a systems man- 
ager or a researcher would then have to manage, process, clean, and ana- 
lyze. The technologies we are using are situated, personal, and political, but 
they also require practical interventions for use; they are indeed ways of life. 

The ultimate compromise digital sound studies will face in negotiating 
authenticity and computational tractability is not new to sound studies: it 
includes any attempt to perceive the world outside the biases we bring to 
everything we do. In his 1889 article “On Alternating Sounds,” for instance, 
Franz Boas considers the extent to which a philologist’s field notes reflect 
the phonetics of his own language and writes that in the field, philologists 
“reduce to writing a language which they hear for the first time and of the 
structure of which they have no knowledge whatsoever. ... Each apperceives 
the unknown sounds by the means of the sounds of his own language.” *° 
Indeed, it is the compromises that we will make as we model, engage, and 
interpret digital sound in new ways that will provide opportunities for prov- 
ocation and for questioning our unavoidable biases as listeners. 


NOTES 


1 Bernstein, Close Listening; Clement, “Distant Listening.” 

2 Quote from Haraway, “Situated Knowledges,” 583. See also Bowker and Star, 
Sorting Things Out; Bardzell and Bardzell, “Towards a Feminist HCI Method- 
ology”; Berg, “Politics of Technology”; Feinberg, “Two Kinds of Evidence”; 
Frohmann, Deflating Information. 

3 Bowker and Star, Sorting Things Out, 34. 

4 Tanya E. Clement is the primary investigator of the HiPSTAS project. Please see 
more information at www.hipstas.org. 

5 The project continues with a second NEH grant from Preservation and Access 
for Research and Development, titled HiPSTAS for Research and Development 
with Repositories (HRDR). Please visit www.hipstas.org. 

6 Downie etal., “Novel Interface Services.” 

7 Launched January 1, 2005, PennSound is the largest collection of poetry sound 
files available for noncommercial distribution on the Internet. PennSound is 
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codirected by Charles Bernstein and Al Filreis and associated with the Center 
for Programs in Contemporary Writing and School of Arts and Sciences Com- 
puting at the University of Pennsylvania. 

The meeting took place at the PennSound offices in Philadelphia, October 26, 
2013, including the PennSound directors Al Filreis and Charles Bernstein as 
well as a host of their senior editors and technical advisors (Michael Henessey, 
Chris Martin, Steve McLaughlin, Danny Snelson, and others). 

Bernstein, Attack of the Difficult Poems, 126. 

Sterne, “Sonic Imaginations,” 11. 

Bowker and Star, Sorting Things Out, 37. 

Bowker and Star, Sorting Things Out, 37-40. 

Bowker and Star, Sorting Things Out, 44. 

Karpinski, “Boundaries of Language.” 

Rooth and Wagner, “Harvesting Speech Datasets”; Crystal and Quirk, Systems. 
Karpinski, “Boundaries of Language,” 41. 

Becker et al., “Rule-Based Prosody.” 

Karpinski, “Boundaries of Language.” While gestures are very important to 
any oral performance such as poetry, they are not the focus of this study. 
Karpinski, “Boundaries of Language,” 43. 

Crystal and Quirk, Systems, 42. 

Crystal and Quirk, Systems, 42. 

Bolinger, Intonation and Its Parts, 11. 

Rooth and Wagner, “Harvesting Speech Datasets.” 

Karpinski, “Boundaries of Language.” 

Karpinski, “Boundaries of Language,” 47. 

Karpiński, “Boundaries of Language”; Schmidt, “TEI-Based Approach.” TEI, 
TEI P5 cites Boase (London-Lund Corpus) as a reference for these materials, but 
this text was never published (according to Edwards and Lampert, Talking Data) 
and is no longer available. A conversation with Lou Burnard led me to Crystal 
and Quirk (Systems) as an alternative reference for these descriptions. 

Crystal and Quirk, Systems. 

Bernstein, Attack of the Difficult Poems, 127. 

Bernstein, Attack of the Difficult Poems, 127. 

Bowker and Star, Sorting Things Out, 34. 

TEI Consortium, TEI P5. 

See Johansson et al., “TEI AI2 M1”; “TEI AI2 M2”; and “TEI AI2 W1.” 
Johansson, “Encoding of Spoken Texts,” 150. 

Sperberg-McQueen and Bumarde, “Guidelines.” 

Johansson et al., “TEI AI2 M1.” 

Johansson et al., “TEI AI2 M1.” 

TEI Consortium, TEI P5. 

Johansson et al., “TEI AI2 M2.” 
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mendations reiterate this definition: “The goal of an electronic representation 
is to provide a text which can be manipulated by computer to study the partic- 
ular features which the researcher wants to focus on” (Johansson et al., “TEI 
A12 W1”); and the current guidelines state conclusively: “Speech regarded as 
a purely acoustic phenomenon may well require different methods from those 
outlined here, as may speech regarded solely as a process of social interaction” 
(TEI Consortium, TEI P5). 

TEI Consortium, TEI P5. 

FADGI, “Embedded Metadata in Broadcast WAVE Files.” 

These include c1DOc’s Conceptual Reference Model (CRM), the Library of 
Congress’s Functional Requirements for Bibliographic Records (FRBR), the 
Dublin Core Metadata Initiative (DCM1), Contextual Ontology Architecture 
(coa), and the Motion Picture Experts Group rights management standard, 
MPEG-21.RDF (IASA). These features are also captured in TEI P5. 

Tedlock, Spoken Word, 249. Tedlock’s Spoken Word is also referenced in Johans- 
son etal., “TEI AI2 M1”; Johansson etal., “TEI AI2 M2”; Sherwood, “Elaborate 
Versionings”; and Bernstein, Close Listening. 

Chion, “Three Listening Modes,” 50. 

Bernstein, Close Listening, 13. 

Sherwood, “Elaborate Versionings.” 

Sherwood, “Elaborate Versionings”; Bernstein, Attack of the Difficult Poems, 127. 
Crystal and Quirk, Systems, 42. 

For example, Adriana Cavarero argues for demythicizing oral performance. 
She critiques the viewpoint of Chion (“Three Listening Modes”), McLuhan 
(Essential McLuhan), and Ong (Presence of the Word), who at once essentialize 

the voice as “presence” and disembody and mythicize orality. Oral culture, 
McLuhan argues, gives “us simultaneous access to all pasts. As for tribal 
man, for us there is no history. All is present, and the mundane becomes 
mythic” (Essential McLuhan, 370). With this viewpoint, Cavarero asserts, we 
treat language as a code “whose semantic soul aspires to the universal” and 
render “imperceptible what is proper to the voice” (“Multiple Voices,” 530). 
FADGI, “Embedded Metadata in Broadcast WAVE Files.” 

Karpinski, “Boundaries of Language.” 

Karpinski, “Boundaries of Language,” 47. 

Schmidt, “TEI-Based Approach.” 

“An Interesting Session.” 

Tsur, Poetic Rhythm, 14. 

Boas is quoted in Tsur, Poetic Rhythm, 51. 
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“A FOREIGN SOUND TO YOUR EAR” 


Digital Image Sonification for 


Historical Interpretation 


MICHAEL J. KRAMER 


So don’t fear if you hear a foreign sound to your ear. 
— BOB DYLAN, “It’s Alright Ma (I’m Only Bleeding)” 


INTRODUCTION: Mance Lipscomb’s Silhouette 


Photographs are visible, but photography is not only 
a “visual” practice. 


— MARGARET OLIN, Touching Photographs 


We see a musician’s back in silhouette. He sits in a chair, on an outdoor 
stage, facing away from view. A microphone stand rises in front of him while 
an acoustic guitar head, with its tuning pegs, juts out from one side of his 
body. You can just make out the horizontal stripes on the back of his work 
shirt. There is a large audience before him, sitting in steeply raked rows. 
In contrast to his shadowy form, their bodies are illuminated by sunlight 
(fig. 8.1). 

The image is silent, of course; we cannot hear anything. Nonetheless, as 
a visual portrayal of a powerful sonic moment, it speaks volumes. Taken at 


FIGURE 8.1 Mance Lipscomb performs at the Berkeley Folk Music Festival, 


July 1963. Photographer unknown (possibly Philip Olivier). COURTESY OF BERKELEY 


FOLK FESTIVAL ARCHIVE AT NORTHWESTERN UNIVERSITY SPECIAL COLLECTIONS. 


a folk music festival, the photograph conveys the intense attention this lone 
performer commands from the crowd. The man on stage is African Ameri- 
can songster Mance Lipscomb, a sharecropper and musician from Navasota, 
Texas. He performs on a beautiful summer day in 1963 at the Berkeley Folk 
Music Festival, which took place annually between 1958 and 1970 on the Uni- 
versity of California’s flagship campus. The photograph captures the second 
appearance of Lipscomb at the Berkeley festival after his debut at the 1961 
event. Assisted in his journey to California by folklorist Chris Strachwitz, 
this working-class black man, raised under the oppressive conditions of Jim 
Crow segregation, appears before a primarily white, middle-class audience.’ 
Lipscomb plays his bluesy acoustic songs at the Greek Amphitheater. The 
venue, whose construction was funded by California newspaper magnate 
William Randolph Hearst at the turn of the twentieth century, was modeled 
after the ancient open-air venue at Epidaurus. It was intended to serve as a 
symbol of Berkeley’s aspirations to become the “Athens of the West.”? That 
afternoon in the summer of 1963, at the crown jewel of California’s presti- 
gious postwar system of public higher education, ina space designed to link 
modern American democratic aspirations to classical antiquity, a man born 
to slaves took center stage.? 
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The photograph resides in the Berkeley Folk Music Festival Archive, which 
is housed in Northwestern University’s Charles Deering McCormick Library 
of Special Collections and consists of over 35,000 artifacts. Currently in the 
process of digitization, the archive’s holdings include business records, 
correspondence, notes, publicity materials, and much more, but the richest 
documentation is visual: posters, programs, and especially photographs, 
of which there are over 10,000.* This particular image captures a crucial 
moment of folk-revival transformation. In the click of the camera, Mance 
Lipscomb emerges from the shadows into the light, from the margins of 
society to a new place of prominence. We get to see the African American 
songster in the process of dissolving from one role into another—we watch 
the silhouette of a rural Texas sharecropper becoming a global folk music 
legend. 

There is plenty to notice in the visual details of this photograph, but the 
Berkeley Folk Music Festival was, as its name suggests, a fundamentally au- 
ral event. As images such as this one go digital, can computational analysis 
reveal more about the sonic dimensions of the festival—and about the place 
of sound in historical understanding more broadly? To be sure, we cannot 
(at least not yet) magically recover the music being made in the instant when 
this photograph was taken. What we can do is move between the optic and 
the aural through new circuits of computational exploration to bring out 
concealed historical information and to generate more compelling histor- 
ical interpretations. This chapter argues that through practices of digital 
image sonification we can expand what Fred Gibbs and Trevor Owens call 
“the hermeneutics of data and historical writing.”* The digital “remedia- 
tion” of the image—its passage from an earlier mode of representation into 
binary data—provides an opportunity to open ears as well as eyes more fully 
to the echoes of the past.° We not only can access but also experience and 
analyze artifacts and evidence in fresh ways to produce better history from 
our source materials. 

Viewing a digital version of Mance Lipscomb’s silhouette at the Berkeley 
Folk Music Festival in 1963 means that at one level we are no longer looking 
at the original photograph. We are instead looking at it through many re- 
moves: a digital version of a photographic print taken from a negative that 
used chemical processes to register light on bodies and objects in a past 
moment. Scanned digital images do some hard travelin’, and these displace- 
ments may be troubling to the historically minded. Is the past receding from 
view as primary sources shift from older modes of mediation such as print 
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and photography to the digital domain? Are we taking one more step back 
from the original moment in time? I contend no. Digitization does not nec- 
essarily mark a loss of access to evidence. Nor does it inevitably distort the 
past.” As this essay investigates, remediation becomes an opportunity for 
developing more critical thinking about the ontology—which is to say the 
very being—of what historical sources are and, from there, for harnessing 
the specific qualities of encoded digital data to foster more sensitive inter- 
pretations of history. 

We should keep in mind, of course, that no artifact prior to the digital— 
whether it be text, sound recording, moving image, or object—offers an 
entirely transparent view of history. They are all mediations of one sort or 
another. With their odd combination of immediacy and distancing, photo- 
graphs are an especially uncanny mode of representation, as commentators 
such as Roland Barthes and Susan Sontag have famously noted.* When a 
1963 photograph of Mance Lipscomb moves into digital form, it becomes 
the newest link in an ongoing chain of representational reconfigurations 
stretching back to the moment in time itself. And even that moment has 
a medial quality in that Lipscomb’s appearance at the Berkeley Folk Music 
Festival took place within a performance context and within a history of folk 
revival values, ideas, expectations, and relationships.’ Here is not merely 
“raw data” to be plotted, measured, and visualized in some reductive quan- 
titative manner, but rather a remediated representation of the past that can 
be processed and analyzed—both by computers and by humans—through 
methods made possible by its shift in underlying format to the digital 
domain.” 

What is intriguing about that underlying format is that digitized photo- 
graphs are more ductile, modular, and pliable in relation to other artifacts 
when all move into the compatible state of binary code. Computers, in this 
sense, are convergence machines: they bring into one unified underlying 
form what previously were quite different types of mediation.” In the digital 
domain, we might still speak of images, sounds, or text as distinct catego- 
ries, but at the computational level they are all now bits and bytes, electronic 
on-and-off pulsations. 

What can we do with this convergence into binary code? Among digital 
humanities scholars, a kind of synesthetic approach is emerging. Texts get 
charted, physical spaces interactively mapped, sounds graphed. The urge, 
however, is almost entirely to visualize data.** The optic dominates. Yet as 
a sonic event, the Berkeley Folk Music Festival asks that we also attend to 
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the aural. We might do so by adding “sonification” to the mix alongside 
visualization." 

What follow are descriptions of three experiments with digital image 
sonification. Each seeks to reveal new interpretations of the Berkeley Folk 
Music Festival and the history of the U.S. folk music revival in the 1960s 
and to examine post-World War II American cultural history more broadly.” 
Taken together, they present the outlines of a hermeneutic approach to dig- 
ital data that centers on shifting images into the domain of sound through 
their shared form as computer code.’ First, digital sound design draws on 
practices in theater and cinema production to pair related images and 
sounds. These pairings, even if taken from different events, moments in 
time, or locations, offer new combinatory representations of the past that 
illuminate—amplify might be the more accurate term—historical mean- 
ings. Second, data fusion brings together digital data to produce a new multi- 
media object, and with it fresh historical knowledge. Finally, data sonification 
unleashes sounds from the data of the visual medium itself; hearing the data 
of an image allows one to see it differently; this expanded sensory access 
to evidence provides an impetus to more accurate and original historical 
interpretation. These three activities—digital sound design, data fusion, 
and direct sound sonification—remind us that the digital has the capacity 
to deepen our understanding of the past if we use computers inventively. In 
the digital medium, we can do more than just stare at Mance Lipscomb’s 
silhouette; we can also more fully sound out its significance. 


DIGITAL SOUND DESIGN: A Mount Rushmore of the Folk Revival 


Sustained interpretative engagement, not efficient 
completion of tasks, would be the desired outcome. 
— JOHANNA DRUCKER, “Performative Materiality 


and Theoretical Approaches to Interface” 


The trio of faces and upper bodies forms a kind of Mount Rushmore of the 
folk revival. Photographed in 1964, blues songster “Mississippi” John Hurt, 
Appalachian folk singer Arthel Lane “Doc” Watson, and Berkeley master 
of ceremonies as well as songwriter, folk singer, and professor of ocean- 
ography Sam Hinton stand together, shoulder to shoulder, backstage at 
the Greek Amphitheater during the Berkeley Folk Music Festival (fig. 8.2). 
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FIGURE 8.2 “Mississippi” John Hurt, Sam Hinton, and Arthel “Doc” Watson at the 


Berkeley Folk Music Festival, 1964. PHOTOGRAPH BY KELLY HART. COURTESY OF BERKELEY 


FOLK FESTIVAL ARCHIVE AT NORTHWESTERN UNIVERSITY SPECIAL COLLECTIONS. 


There is no known audio of Hurt, Hinton, and Watson performing at the 
1964 Berkeley festival; however, the three performers were making studio 
recordings (as well as live recordings at other venues) at the time. In digital 
sound design, these audio tracks can be paired up with the image in com- 
binatory patterns that heighten our sense of the ways in which the formal 
details in the photograph and audio recordings relate to larger cultural con- 
texts and interpretive ideas. 

Borrowed from film, television, and theater production, concepts of 
sound design pay close attention to how sound accompanies visual repre- 
sentation and vice versa.* In the digital medium, sound design offers a 
framework for uniting—or more precisely, collaging—previously unlinked 
historical images and sounds to bring them into perceptual and analytic 
play with one another. It harnesses a kind of “maker” approach for historical 
interpretation.” To be sure, one could do much of this without digital tech- 
nology: a carousel of slides and an old-fashioned cassette boom box might 
do the trick; so too might historical re-creations of past musical events. 
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These fictitiously bring “alive” the past by inventively mixing sound and 
images. Digital technology does not break with these approaches but rather 
enhances them in two ways: through intensified “versioning” that allows 
one to compare many different iterations of sonic and visual materials; and 
through the introduction of chance operations and generative possibilities 
derived from algorithmic manipulations. 

To be clear, my goal is not to join recordings of Mississippi John Hurt, Doc 
Watson, or Sam Hinton to the “Mount Rushmore” image of them because 
doing so would offer an unmediated and pure path back to the past. Instead, 
my efforts turn in precisely the other direction, embracing the remix as his- 
torical consciousness itself. To experiment with digital sound design is to 
engage with fraught but lively alignments and realignments of image and 
sound across impossible distances of time. It is to reassemble evidentiary 
elements in creative ways to better understand the past, not magically re- 
visit itas some kind of fantastical virginal state. The many sonic and visual 
details of a digital sound design strike against each other synesthetically, 
reminding us that we only can know the pastas a constellation of fragments 
that are always in motion, pushing and pulling on each other, producing 
a fecundity of interpretive truths out of their relational juxtapositions and 
associations as intermixed evidence.” 

To start, let us look at the image of Mississippi John Hurt, Sam Hinton, 
and Doc Watson without sound. The trio stand before a wall backstage at 
the Hearst Greek Amphitheater in July 1964. Hurt, the blues songster from 
Avalon, Mississippi, looks off to his left, warmly, with the hint of a smile 
on his lips and his acoustic guitar clutched in the crook his right elbow and 
shoulder. Hinton, the professor of oceanography who served as master of 
ceremonies at the Berkeley Folk Music Festival, looks down with a goofy 
grin, his thin, striped tie stretched straight within the lapels of his tweed 
blazer. The blind multi-instrumentalist Doc Watson holds a banjo from a 
shoulder strap slung over his plaid jacket, pulling it slightly off-kilter, his 
hair neatly parted, but with a tuft sticking up in the back. It is an extraor- 
dinary image in its own right, conveying distinctive qualities that many in 
the folk revival projected onto these three famous revival performers: Hurt’s 
softness and sweetness, Hinton’s genial and endearing awkwardness, and 
Watson’s unflappability. 

Taken by festival staff photographer Kelly Hart on his Pentax camera, 
the photograph also, perhaps accidentally, reveals a lurking ideological urge 
within the 1960s folk movement: itis the dream of constituting an integrated, 
harmonious collective out of the fragmented and painful inequalities of 
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race, class, age, and region in the United States, particularly the American 
South. With the civil rights movement reaching a crest of confrontational 
activity during the summer of 1964— often known as Freedom Summer after 
the name given to the interracial campaigns to register African American 
voters in the Jim Crow South—Hurt, Hinton, and Watson become a kind 
of symbolic string band trio, giving us the look of a more ideal America, 
unified in song. They do so at a festival that took place in the very same 
campus spaces that would soon be taken over by the influential Free Speech 
Movement, underway at Cal in the fall of that same year.” 

But what was the song this symbolic string band trio was playing, exactly? 
How do we better hear as well as see this harmonious image of musical, ra- 
cial, and regional communion? Digitization holds some possibilities. Once 
digitized, the image can be integrated with recordings of Hurt, Hinton, and 
Watson from that same period to create a digital sound design that asks the 
beholder to pivot between image and sound, to hear what these musicians 
sounded like in 1964 in relation to what they look like in the photograph, 
and to be able to do so in a mutating relationship of notes to visual details. 

As an exercise in digital sound design, I created a collage of Hurt’s ver- 
sion of the African American spiritual “Mary, Don’t You Weep” (recorded by 
Peter V. Kuykendall at Wynwood Recording Studio in Falls Church, Virginia, 
in March 1964) and Doc Watson’s version of the Dock Boggs song “Country 
Blues,” which was released on Watson’s debut album for Vanguard Records, 
also in 1964.” The process of editing the two tracks together, interspersing 
verses and sections into and out of one another using the free sound-editing 
software Audacity, caused me to pay far more careful attention to the mu- 
sic’s content, tone, and more subtle performative dimensions (fig. 8.3).? 

I became far more sensitive to Hurt’s loping fingerpicked guitar style, 
so laconic yet determined, as Watson’s relentless clawhammer banjo attack 
intrudes on it. The timbres ring out in such contrast: Hurt’s thuddy, steady 
guitar playing compared to Watson’s twangy picking, which pushes for- 
ward, clanging with urgency. Yet the two sounds are connected: when the 
performances were collaged, the syncopations of Hurt’s melodic work on 
the upper strings of his guitar suddenly resembled Watson’s banjo work. 
And the North Carolinian’s great rhythmic sense, undergirding his cascades 
of notes, became crucial to his playing when juxtaposed against the famous, 
thumping tick-tock of Hurt’s thumbed bassline, such a quintessential part 
of his sound. Here are two styles of playing stringed instruments that are 
quite different, they share certain qualities.” 

The texts of each song are different, too—indeed almost opposite each 
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FIGURE 8.3 Remixing Mississippi John Hurt and Doc Watson in Audacity sound- 
editing software. 


other. Hurt sings a religious hymn while Watson performs a sinner’s lament. 
The character in “Mary, Don’t You Weep” almost seems to be singing to him- 
self, but his story is one of collective perseverance: “If I could I surely would 
stand on the rock where Moses stood. . . Pharoah’s army got drownded, oh 
Mary don’t you weep.” The character in Watson’s “Country Blues” sings to 
an audience but speaks of inner demons driving him to ruin: “Come all you 
good time people, while I’ve got money to spend.” Hurt’s words are about 
endurance while Watson’s are about a kind of explosion of agony. Hurt’s are 
testimonial, while Watson’s are confessional. Yet the words start to intersect 
with each other as well, in the sense that both musicians’ songs emphasize 
strength in the face of struggle, a refusal to look away from pain, fear, or 
threats of annihilation. 

Stylistic musical comparison is one thing, but collaging Hurt’s and 
Waton’s respective sound recordings to then listen to them while looking 
at the photograph of the two men along with Sam Hinton asks us to more 
carefully consider how the image works as symbolic commentary both 
within and on the folk revival. It is, of course, just a photograph snapped 
backstage of these three stars of the folk scene, and yet the performers carry 
representational meaning and affective energy with their bodies. Because I 
purposely left Hinton’s music out of the mix to emphasize his role as inter- 
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loper and interlocutor, the digital sound design intensifies the question of 
how the South was represented, how its presence lurked, in the image. I had 
noticed the question of region in a superficial manner when simply looking 
at the photograph, but the more I looked and listened simultaneously, the 
more geographic negotiations began to ring out. The image offers a rich 
iconographic representation of the folk music revival’s intense focus on the 
South even as it took place way out West. At Berkeley, in images such as 
this one, the desire to remix the American South’s legacy of racial segre- 
gation and oppression is prominently on display. I did not see this until I 
heard it: collaging Hurt’s and Watson’s music as a soundtrack for looking at 
Hart’s photograph revealed the regional interplay between South and West 
as antagonistic race relations were reimagined into new, more integrated 
formations. 

Sound also heightened my awareness that the very bodies of the figures 
themselves make this symbolic racial and regional remixing possible. After 
all, these bodies, viewable, are most known for the sounds they made. To 
deliver to the image their sonic power as folk-revival performers in 1964. 
allows the intersections of body, music, culture, race, and region to emerge 
more evocatively. Sound and image together, in other words, produce a 
greater sense—both sensorially and semantically—of the meanings buried 
within the appearance of Hurt and Watson flanking Hinton. Listening to the 
audio collage, I suddenly noticed how these men’s bodies took on archetypal 
demeanors (some might say stereotypical projections) of the folk-revival 
imagination. The camera positions Hurt, the former Mississippi farmhand, 
with an inner calm and deep empathy for others. There is a slight slump to 
his shoulders, but he is not defeated. These are shoulders that could bear 
weight, and did.” The stockiness of his chest is more pronounced, too. In 
life he was a small man, but nota slight one. His posture presents not weak 
humility so much as a strong inner reserve. Sound and image here converge: 
his individual poise and communal energy, the quiet, whispered quality of 
his singing style, seem to trace the creased wrinkles around his eyes and 
mouth. And another quality appears, too, one central to the reception of 
Hurt within the revival: his sly trickster sensibility. The edge of something 
more devilish below the sweetness, some kind of little, indestructible lilt, 
starts to dance across the surface of his gaze, turned away from the camera 
and toward some horizon beyond the frame of the image.” This photograph 
from 1964 does not “come to life,” but the semantic and even the affective 
dimensions of the interaction between photographer, folk-revival milieu, 
and figures in the image itself do. 
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If Mississippi John Hurt’s music and image together intensify an under- 
standing of his appeal as an easy-going African American songster within 
the folk-revival imagination, Doc Watson becomes the fiercely independent 
Appalachian mountain man.” Listening to him perform while looking 
closely at the photograph, I began to consider his toughness, the ferocity 
lurking behind his friendly smile, and, most of all, the way he turned the 
seeming disability of his blindness into an assertion of selfhood. Paired 
with his performance of “Country Blues”—a rounder’s testimonial of stub- 
born rage, pride, fury, and shame—Watson’s appearance in the photograph 
more deeply communicates his role as a heroic figure within the folk-revival 
context. As with Hurt, Watson’s body and sound combine to carry an en- 
tire range of associations about race, class, gender, and region. He is the 
white bluesman, the hearty Appalachian farmer drinking moonshine, the 
millworker on a bender, the gentle sage on a front porch in the mountains, 
all rolled into one. As a performer, Watson drew on all these projections 
placed upon him by folk revivalists, using them for his own expressive ends, 
finding his own place within—and sometimes through—their mediations. 

Additional sonic experiments with the design led me to consider not 
only race and region but also class as a dimension of the photograph. Using 
Audacity, I panned the respective tracks to extreme ends of the stereoscopic 
spectrum, as ifto echo the ways in which Hurt and Watson flank the middle- 
class Californian Sam Hinton. Was one end of the spectrum the Mississippi 
Delta, the other Appalachia? Yes, but the panning effect also made me con- 
sider the commonalities between rural black and white working-class expe- 
riences within southern life. Hurt and Watson came from different regions, 
but the structuring economic and class forces at work in their seemingly 
divergent agrarian settings were not entirely dissimilar. Delta cotton plan- 
tations and Appalachian cotton mills had many things in common, from 
the cotton itself to the kinds of hierarchies of power that arose from har- 
vesting it and bringing it to market in industrialized modes of production.” 
Heard in stereo, Hurt and Watson were not only far apart; they also, as the 
photograph suggests, shared certain class origins that brought them into 
the same space. Even the very sounds they made arose from circulations of 
musical styles across the divisions of region and race, but not necessarily of 
class position, within the South.” The use of two-channel panning height- 
ened my awareness not only of differences but also of similarities between 
the two men, particularly in contrast to Hinton as the more middle-class 
figure, who stands quite literally in the middle between them. 

These basic efforts to bring image and sound together reaped valuable 
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interpretive results, but computation offered additional possibilities by al- 
lowing access to the chance operations made available through algorithmic 
experimentation. For instance, within Audacity one can apply a sliding- 
time-scale/pitch-shift filter to audio data. Rather than alter the audio my- 
self by consciously pairing audio with image, I momentarily ceded greater 
autonomy to the software program and its automated calculations by em- 
ploying the filter. This has an air of avant-garde, John Cage compositional 
philosophy to it, but introducing chance into the sounds also paradoxically 
became a means for deeper, more precise historical scrutiny.” When I ap- 
plied the sliding-time-scale/pitch-shift filter to my audio remix and played 
it while looking at the image, I started to notice issues of gender even more 
profoundly than I had in past viewing/listenings. My use of the filter let the 
computer determine when pitch rose or fell randomly in the audio of Hurt 
and Watson that I had created to accompany the Mount Rushmore image. 
(Imagine the high tones of Alvin and the Chipmunks singing followed sud- 
denly by the basso profundo of Johnny Cash.) 

The coincidences that ensued from using the filter reminded me that 
to alter the pitch of a singer’s voice points to intensely affective, sensorial 
dimensions of masculinity present in musical performance. These are, as 
Barry Shank and others note, quite linked to assumptions about racial iden- 
tity.” The filter raised the pitch of Hurt’s singing, taking it somewhat closer 
in timbre and tone to the more pinched, moaning styles of other Mississippi 
Delta blues singers such as Robert Johnson.” As a contrast to his actual sing- 
ing voice, which was far softer and “mellower,” the altered pitch highlighted 
how he evoked a different kind of black masculinity within the folk-revival 
matrix. Coupled with the image of him in his signature button-up collared 
shirt and bowler hat, the algorithmically altered sound design clarified how 
Hurt, aman whom one folk revivalist described as a leprechaun and another 
as the original hippie, performed this alternative, softer style of masculine 
appearance. It was not an essence but rather an assemblage of what we 
might call “glitched” details that summon gender, race, class, and region 
(we could add age here, too) into play with each other. 

The algorithmic shift raised Hurt’s pitch, but since it was operating on 
a time scale, it lowered the sound of Watson’s voice in my audio remix. His 
altered baritone reminded me of how his singing differed from the more 
famous “high lonesome” sound of bluegrass, perhaps the most famous of 
Appalachian-associated genres of music. To hear the algorithmically trans- 
formed voice of Watson rendered even lower brought out the ways in which 
he might be understood as a transitional figure with regard to questions of 
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gender, race, and region. Within the folk revival, he was a link from the star- 
tling, high-pitched singing of someone like Bill Monroe—whose vocal style, 
as Robert Cantwell argues, arose from very traditional Appalachian modes 
of masculine identity formation—to a singing style more associated with 
the crooning male voice that was commonplace on radio and recordings 
from Watson’s childhood. Typically thought of as the ultimate traditional 
musician who, with the encouragement of folklorist Ralph Rinzler, reached 
back before bluegrass to earlier mountain music styles, Watson might also 
be thought of as reworking traditional white southern rural and working- 
class masculinity into a more modern guise.** In place of the high lonesome 
sound, he sang on the lower frequencies of life at the cusp of tradition and 
modernity. 

He did so in part by channeling into his voice an African American blues 
aesthetic drawn from both Piedmont and Delta traditions." He also retained 
his interest in rockabilly and jazz, which he had been performing in a road- 
house band in North Carolina before meeting Rinzler in the early 1960s.*° 
In the “Mount Rushmore” photograph, Watson’s clothing suddenly takes 
on a new cast. Viewed to the sound of Watson’s computationally lowered 
voice, the musician’s modern-cut, green plaid suit suddenly suggests more 
than first meets the eye in contrast to the banjo that dangles from Watson’s 
shoulder. This traditional musician smuggled various contemporary styles, 
strains, and gestures into his “old-time” sound. 

In these ways, through formal manipulations accomplished both by 
human manipulation and algorithmic computation, digital sound design 
deepens the interpretive possibilities of examining images from the folk 
revival. Digital sound design does not bring us magically back to the past 
itself, for we can never make that journey. What we can do is intently make 
use of digital technology to notice visual and aural details more effectively as 
they relate to larger social and cultural forces. Constructing history through 
the new perceptual filters offered by digital technologies, we may develop 
better interpretations of the past, opening up many lines of thinking rather 
than narrowing analysis to one, limiting position. Digital sound design fos- 
ters an enriched clarity and precision even as it reminds us of the dense mul- 
tiplicity of historical meaning present in the evidentiary record of the past, 
particularly when it comes to cultural expression and experience. Bringing 
a multisensory constellation of imagery and sounds together, digital sound 
design shows how our designs on the past are always shaped by the ways 
we—and now our computers—choose to arrange and rearrange history in 
the present. 
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DATA FUSION: A Revised Humbead’s Revised Map of the World 


Jorge Luis Borges’ story about a map . . . equal in size to the 
territory it represented has been re-written as a story about 
indexes and the data they index. Now the map has become 
larger than the territory. 


— LEV MANOVICH, “Database as Symbolic Form” 


It is certainly a map, but the closer you look, the stranger it gets: San Fran- 
cisco, Los Angeles, New York City, Cambridge, and Berkeley are the major 
countries; North Africa and Southeast Asia are landlocked within them; 
Boston is a small country with a Cape Cod-like peninsula just off the south- 
ern tip of this alternative imagining of the “geospatial” imagination. The 
“Rest of the World” is merely an island on the northwestern periphery, just 
barely bigger than Nashville. Look more closely, and the edges that frame 
the map contain hundreds, even perhaps thousands, of names: a wide- 
ranging, almost crazed list of participants in the mid-twentieth-century 
U.S. folk music revival. It includes everyone from Bob Dylan and Joan Baez 
to lesser-known local folkies to inspirational figures such as Groucho Marx. 
These names encircle and frame “the Great Naked Sea,” out of which a sea 
serpent, a Poseidon-like sea king, and a large yellow bathtub duck all splash. 

This remarkable cartographic fantasy, titled Humbead’s Revised Map of the 
World and conceptualized by Bay Area folk scenester Earl Crabb (Humbead) 
and folk musician, instrument maker, and graphic artist Rick Shubb, offers 
new possibilities for pivoting back and forth between the visual and the 
aural (fig. 8.4). To borrow from the theories of cultural geography and spa- 
tial history, Shubb and Crabb transform absolute space into the relational 
representations of a Bay Area folkie’s “mattering map.”” Which is to say the 
map captures an embedded perspective on place. There is a bird’s-eye view 
here, but what the bird sees on Humbead’s Map reminds us that no two birds 
see the world below them in quite the same way. Rick Shubb remembers that 
the idea for the map arose in 1967 in a Berkeley music shop when Earl Crabb 
commented to a hitchhiker trying to get from Berkeley to Kansas City that 
he should put “New York” on his sign instead when standing by the side of 
the road looking for rides. This was because, for Crabb, “New York is closer.” 
The humorous difference between geographical and cultural distance led 
Crabb and Shubb to the design of a map that reimagined the world from the 
perspective ofa Bay Area folk music participant. Then they added the names 
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FIGURE 8.4 Humbead’s Revised Map of the World, 1968. BY EARL CRABB AND RICK SHUBB. 


around the edges, partly as a gag and also on the theory that this would 
inspire anyone listed to purchase a copy of the map.** 

Sound shaped the making of the map and its content, but, of course, as a 
printed creation it is silent. Once brought into the digital domain, the map 
provides us the opportunity to address the interplay of cartographic visual 
representations and their sonic inspirations in one mediated space. In a 
version of what New Media scholar Lev Manovich calls data fusion, sound 
data can be layered over the digital version of the map in correspondences 
that thicken the contextual historicization of the Berkeley folk music scene. 
Manovich is thinking more of massive combinations of data made possible 
by computation, but his concept also works at smaller scales. It enables 
connections between visual and sonic information that intensify a map’s 
implicit commentaries, in this case the tonal shadings of wit that also 
contain critique. These subtle gestures are at the affective root of this map 
about roots music. A more textured feel for the past results from remediat- 
ing its source materials through the additional layer of digital data fusion. 
Bringing visual and sound elements together provides a more immersive 
experience of the map’s “mapping” of the U.S. folk music revival. 

Manovich defines data fusion as “using data from different sources to create 
new knowledge that is not explicitly contained in any of them.” This is what bring- 
ing sound and image together in a digital version of the map accomplishes. 
In other words, when fused with audio material through creative composi- 
tional choices, Humbead’s Revised Map gets revised once again. In the process 
of sonification, a synesthetic interaction of visual and aural data expresses 
more than either medium could do individually. Whereas the digital sound 
design of Mississippi John Hurt, Doc Watson, and Sam Hinton did some- 
thing similar by layering two media—image and sound—on top of one 
another, data fusion draws on far more sources and puts them into play 
with each other not only to see a photograph’s meanings more robustly but 
also to produce a new kind of object born from the combination of many 
sources. 

Using the common technology of a clickable “image map,” my data fu- 
sion of Humbead’s Revised Map of the World both accentuates and elaborates 
Crabb and Shubb’s conceptual playfulness. It fuses audio clips with various 
objects, landmasses, topographical notations, names, and “nations.” Many 
of these are straightforwardly discographic or informational—clicking 
on a name on the frame of the image, for instance, plays a signature song 
by that performer. But other sounds emphasize the affective experience of 
the map’s cartographic commentary itself. For instance, I once again used 
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Audacity to create sound files at different volumes so that the size of each of 
the map’s countries and regions correlates to the volume of the connected 
audio track. Bigger places in their imaginations sound bigger; they are also 
longer tracks and sometimes contain a greater amount of audio overlaid in 
my Audacity remixes to register the density of sonic information shaping 
the cartographic visual representations on Humbead’s Map. Berkeley, San 
Francisco, New York City, and Cambridge play louder, longer, and more 
densely textured audio tracks, while Los Angeles is quieter, shorter, and 
simpler. Here, through sonification, I figuratively (and literally) turned up 
the volume on the map, using sound to intensify its cartographic choices 
and their implicit meanings. 

Further sonifications and data fusions included placing transitional 
tracks at the boundaries between each “nation.” At the border of New York 
City and Cambridge, one can select the introduction to Bob Dylan’s version 
of “Baby Let Me Follow You Down,” which mentions the “green pastures 
of Harvard University” as the place where he claims to have learned the 
song from fellow folk-scene hipster Eric Von Schmidt.*° Recorded in New 
York City while Dylan was gaining acclaim in the Greenwich Village folk 
scene, the song’s introduction is a snippet of audio that resonates with the 
geographic imaginings of Crabb and Shubb out on the West Coast in terms 
of the relationships and connections it reveals within the networks of the 
folk revival. 

As it should, the duck in the middle of the ocean quacks. 

One shortcoming of the sonification of Humbead’s Revised Map is that it 
still privileges the visual over the aural: one has to see and click on the map 
in order to hear its sounds. In the future, I hope to create a version that 
reverses this orientation: it would consist of audio tracks that one selects 
to reveal visual information from the map. So too, the image map might 
become more fully interactive. The ability for users to add and further remix 
data would take advantage of data fusion to remind us of the social—even, 
potentially, the contested—nature of how the geographic and social rela- 
tionships of the folk revival have been characterized. Users might be able, 
one day, to develop their own “mattering maps” of the folk revival, revising 
Humbead’s Revised Map of the World yet again. 

Overall, the effort to sonify the map not only fills in the sonic gaps but 
also amplifies the sensorial and affective dimensions that contributed to 
and were so crucial to its making and its effects. Data fusion produces a 
new object, and in doing so, it joins the spirit of revision already present 
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in the original Humbead’s Revised Map. Working at the experiential level, the 
distortions of the map that emerge from digital sonification can be helpful 
for getting a better feel for the “worldviews” that created the map. After all, 
the original map is itself already a kind of distortion. (And what map isn’t, 
even as it also conveys accurate information about what it is mapping?) 
Moving away from a historical document by digitally manipulating it can 
allow one, ironically, to get closer to it. Here one can access, experience, 
and then contemplate the particular sounds and the sensations that under- 
gird the ideas of Crabb and Shubb. Data fusion seeks to avoid the mistake of 
privileging sight and seeing over sound and hearing. Through a synesthetic 
fusion of the senses, it reminds us that historians often mistakenly privi- 
lege the optic, with its rationalistic associations (“seeing is believing”) over 
the aural, with its emotional connotations (“If music be the food of love, 
play on”). Data fusion challenges the too-strong distinction that historians 
make between vision and sound and between thought and feeling, offering 
instead a digital method for navigating their fluidity rather than asserting 
one over the other. 

Fusion does not render Humbead’s Revised Map into a unified, static whole, 
but rather delivers the knowledge that past historical moments and move- 
ments were just that: contingent, itinerant, in motion, never complete. The 
data fusion is a mutating assemblage in which audio and visual components 
come together into a newly mediated and provisional object. Nonetheless, 
its dynamic characteristics make it possible to mount many arguments 
about what the map contains. One can begin to piece together how the 
small details and silenced references of sound relate to the cartographic 
representation as a whole—what makes it funny yet serious all at once. Data 
fusion provides a way to consider the evidentiary movement among scales of 
knowledge, information, sensation, and emotion that made the folk revival 
feel like a movement, a more coherent and energized social formation. 

Rocketing Humbead’s Revised Map into the digital medium of fused data, 
revising it yet again, the sonification also reminds us that as much as older 
media forms are, as media historian Lisa Gitelman has argued, “always 
already new,” they are also the opposite: they are always already old.“ They 
are embedded in the past and can still relay its meanings. Indeed, they do so 
precisely through the compositional reconfigurations of data fusion. Like a 
space-age compass, data fusion charts a way forward for navigating maps 
of the past. 
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DATA SONIFICATION: Transferring Mance Lipscomb 


The relative openness of the image/sound . . . create[s] 
a space for shared or alternative perspectives. 
— VIRGINIA KUHN AND VICKI CALLAHAN, 


“Nomadic Archives: Remix and the Drift to Praxis” 


Both digital sound design and data fusion involve bringing new sounds to 
bear on existing images, but the possibility also arises for transforming im- 
age data itself into sound. The third and final sonification I propose can 
be called data sonification.* Working with the photograph of Mance Lip- 
scomb taken at the 1963 Berkeley Folk Music Festival, I wondered if new 
interpretations of it could be rendered from transforming visual data into 
correlated sound outputs. In other words, could we better hear than see the 
photograph’s staging of this particular southern, rural, African American 
musician’s unlikely arrival onstage to play to a large crowd at a neoclassi- 
cal amphitheater built into the hillside of the flagship public university of 
California? Would hearing this visual representation allow a historian to 
analyze it more perceptively? How might a different sensorial reception of 
the image spark new interpretive perspectives on it? What would it mean to 
hear an image by listening to its digital data? 

The answer to these questions rests largely on the choices made in how 
to process and output the visual data into sonic form. What computer 
programmers refer to as the “architecture” of the correlation between in- 
coming, processed, and output data becomes the key issue. In developing a 
particular architecture for data sonification, I began to consider what within 
the design and logic of visual code (pixels, color hues, grids, vectors, and 
even the isomorphic algorithms that make possible tactics such as shape 
and facial recognition) might be productively fed into certain strategies of 
sound synthesis (MIDI technology for instance) to generate audio tracks 
that originated in the visual data but took aural output form.* As I have 
previously noted, the resulting creations were not made with the intent of 
recovering the sounds being made when a photograph was taken. The goal 
is not to return miraculously and without distortion to a past reality through 
some legerdemain of data-manipulation magic. Instead, it is to acknowl- 
edge that we always construct history through the form and content of our 
source materials. These require the development of a hermeneutics, a way of 
interpreting.** What direct data sonification offers to a digital hermeneutics 
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is a particularly intriguing way of exploring strategies for pivoting between 
the optic and the aural. Movement between image and sound through their 
now-shared ontological status as digital data synesthetically brings the eye 
and ear into new kinds of sensory dialogues, enhancing perceptual access to 
an artifact such as a photograph. From this interplay, fresh interpretations 
of the historical information contained within an image can arise.* 

To begin my data sonification experiment with the image of Mance 
Lipscomb’s silhouette at Berkeley in 1963, I wanted to know more about 
how data that constitute the pixels might be sonified. I adapted ideas about 
“slitching” from Trevor Owens’s essay “Glitching Files for Understanding: 
Avoiding Screen Essentialism in Three Easy Steps.” As Owens points out, 
“Digital objects are encoded information. They are bits encoded on some 
sort of medium. We use various kinds of software to interact with and under- 
stand those bits. In the simplest terms software reads those bits and renders 
them.”*° Using an MP3 recording of the “West Virginia Rag” from the Henry 
Reed Collection as one of his examples, Owens purposefully mismatches 
software applications with different file types so that one begins to visualize 
how the file types contain information. Most strikingly (and obviously when 
one thinks about it), just as a WAV audio file possesses more sonic data than 
an algorithmically compressed MP3 file, so too when it is viewed as a “raw” 
file in an image editor, the wav file looks bigger and more spread out than 
the Mp3 file. You can see the audio compression of sound with your eyes. 

What if we move in the opposite direction to try to hear visual data? The 
raw file proved to be the key starting point for reversing this process and 
considering how instead of visualizing sound, one might sonify an image. 
The raw file of a photograph is sometimes known as a “digital negative” be- 
cause it contains minimally processed data ofa digitally created image. This 
file type, in other words, consists of what a digital lens translated from light 
and color in the world into the pixelated patterns of digital code. Outputting 
the photograph of Mance Lipscomb at Berkeley in 1963 as a raw data file via a 
text editor, I began simply by importing the file into Audacity sound-editing 
software (fig. 8.5). The result was not particularly useful to the human ear for 
listening: a solid roar of static sounded something like Lou Reed’s famous 
album Metal Machine Music.” The experiment did not produce particularly 
useful results for interpretation, but it did serve as a good reminder that 
what we might idealize as the most direct, unmediated, and pure transla- 
tion of historical data is not, when it comes to computational remediation, 
necessarily the most productive for generating valuable perspectives on the 
past. Linking visual data to sonic form requires more elaborate sound syn- 
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FIGURE 8.5 Mance Lipscomb at Berkeley, 1963, imported into Audacity from raw 
JPEG data. 


thesis strategies. Sometimes you have to mess with your source materials 
more adventurously to grasp their significance more accurately. 

My next experiment involved importing the digital image of Lipscomb 
into the Photosounder program designed by Michel Rouzic (fig. 8.6). Pho- 
tosounder maps a JPEG file across a spectrogram whose x-axis is time and 
y-axis is pitch and moves by default (it is adjustable) from a low frequency 
of 27.5 hertz to a high frequency of 20 kilohertz. As the pixels of the image 
are placed within this two-dimensional Cartesian coordinate system, the 
intensity/brightness of each pixel is sonified through a filtered cross be- 
tween white noise and pink noise: the more intense or brighter the pixel, the 
louder the noise.** What emerged from the shift to Photosounder showed 
that the program’s sound synthesis strategy more evocatively represented 
the relations of color density found in the visual data than Audacity did with 
araw file type. 

Most fascinatingly, by offering a sonification that combined “pink noise” 
and “white noise” rather than generating pure sine waves, Photosounder 
amplified the centrality of Lipscomb’s silhouetted figure. The sonification 
strategy produced sounds that the human ear could decipher as varying tim- 
bres, allowing one to hear densities of visual information more evocatively 
than one might see them. As I played the Mance Lipscomb photograph from 
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left to right, the resulting sonification suddenly went silent when it reached 
Lipscomb’s body at the center of the image. Then the noise, which sounded 
like radio static, grew louder as the sonification reached the other side of his 
figure and once again registered the audience pictured in the photograph. 

The sonification led me to think far more carefully about the kinds of 
projections that foll-revival audiences at the Greek Theater enacted upon 
Lipscomb as he performed before them in the early 1960s. At first glance, 
the photograph emphasizes Lipscomb’s very real arrival at center stage. 
He is there, present, basking in the attention of a new audience. This is a 
celebration. However, the Photosounder sonification suggested almost the 
opposite interpretation of the image: instead of placing him at center stage, 
it rendered him spectral and ghostly. As with Mississippi John Hurt and 
Doc Watson, did Lipscomb also become less a real person than a kind of 
symbolic keyhole through which folk revivalists thought they could unlock 
a whole different configuration of social relationships when it came to race, 
region, class, community, and the very self in modern America? 

Here in the direct data sonification, the power of the photograph as a 
visual documentation of an aural event announces itself more clearly. The 
sonification reveals how Lipscomb was both extremely real to his new audi- 
ence and also an enigma. He moved to the center of the folk revival, but as 
a silhouette, re-representing his past as an African American sharecropper 
and musician in rural Navisota while leaving that past behind. He achieved 
a whole new status as a musician and a person by carrying the shadow of 
that other history into broad daylight out west in Berkeley. In the click of a 
camera’s shutter, the shadow becomes the substance, the man is his image. 
His silhouette, then, is not only an outline of the man but also a kind of 
opening, an aperture, an entry point into his larger cultural moment and 
the place that he, his audience, and all their history occupy within it. All the 
explicit and implicit negotiations, appropriations, adjustments, disorienta- 
tions, alienations, connections, affiliations, and social interactions across 
boundaries of identity and power roar forth in the mix of photographic 
image and its silent silhouette of data. 

Reheard through a sonic amplification of its formal qualities, the image 
more vividly suggests the power of the performance we glimpse in the still 
shot. Captured through a lens at the Greek Theater, Lipscomb captivates. 
The songster from Jim Crow Texas, born in 1895 as the son of former slaves, 
becomes a kind of king, a nobleman. He sits on a folksy wooden throne. Yet 
he is also small compared to the massive audience watching him. So who is 
ruling whom here, exactly? Perhaps what we glimpse in the image when we 
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FIGURE 8.6 Mance Lipscomb at Berkeley, 1963, imported into Photosounder 
application. 


listen to it sonified is, most ofall, a transition, what folk-revival scholar Rob- 
ert Cantwell calls the process of “ethnomimesis.”*? As Lipscomb traverses 
not only the physical but also the social distances between black working- 
class life in Navasota and a sunny, leisurely day on the Berkeley campus in 
the early 1960s, he crosses the threshold into the folk revival. He plays his 
past, as authentic as could be, but his performance also becomes a mimetic 
act of ethnic re-representation. He is performing himself in a new way. He 
has to. It is the only way as a performer he can reach across the divides of 
social location to connect with this new audience. As this cultural process 
occurs, we witness Lipscomb entering a different world, settling into a 
different position, and attaining a previously unavailable status. He does 
so as a charismatic performer “playing the folk,” a man in the process of 
discovering a newfound currency gained by his virtuosic access to a fading, 
southern, African American vernacular musical tradition.*° He is utterly 
real, but he is also, in the very same instant, a silhouette, a blank slate for 
the projection of fantasies, dreams, and desires by those now watching and 
listening to him across a chasm of social difference. 

By turning this shadowy, silent photograph of Lipscomb making music 
at Berkeley in 1963 back into sound—a very different sound than the ones 
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Lipscomb made on stage that afternoon to be sure, but sound nonetheless 
—Photosounder helped me access a sharper, more accurate interpretive 
analysis of the historical moment. Even my rather technologically simple 
sonification was capable of doing so, and Photosounder provides ample 
additional opportunities for playing with the visual image data to create 
further sonifications of the image, including the ability to adjust frequency 
ranges, pixels per second, and even to manipulate pixels themselves using a 
set of “spray tools.” The opportunities are many to experiment at the level of 
pixels in order to seek out their historical meaning. One can turn up the vol- 
ume on certain characteristics or tone down others. In the transit between 
visual inputs and sonic outputs, iterative play can lead to interpretive discov- 
ery. These synesthetic collisions of image and sound are not reductive but 
rather generative of multiple ways of experiencing and better understanding 
even one historical artifact. 

Other software applications and design approaches might foster addi- 
tional sound synthesis strategies. For instance, one might extract semantic 
information rather than formal qualities from image data. Much as facial 
recognition software works now, isomorphic feature extraction could be em- 
ployed to capture, for example, what instruments appear in the photographs 
of the Berkeley Folk Music Festival. How many banjos are in photographs 
compared to guitars? Do the ratios change over the festival’s duration from 
1958 to 1970? What are the various expressions that appear on Joan Baez’s 
face as she performs onstage as compared to the many offstage portraits of 
her in the festival archive? Where are the eyes of audience members look- 
ing in the thousands of performance photographs? Analyzed statistically 
over this large data set, does gaze indicate something about what makes a 
particular performer charismatic or a specific concert setting enthralling 
for folk-revival participants? Sonification, in turn, might prove effective for 
perceiving undetected patterns in these kinds of semantic data extractions, 
for it produces a different kind of sensory experience of the data than visu- 
alization does." 

Overall, visual image sonification functions well on multiple scales: one 
can delve deeply into the meaning of the pixels in one image, or even a detail 
of one image, or one can go big, exploring patterns in hundreds or thou- 
sands of images. Whether it be of Mance Lipscomb’s singular silhouette 
one summer day in 1963 or a sense of the ten thousand—plus images in the 
Berkeley Folk Music Festival archive, sonification enhances the perceptual 
and sensorial dimensions of historical inquiry by turning digital humanities 


“A FOREIGN SOUND TO YOUR EAR” . 201 


analysis toward the core humanities practice of expanding the pathways 
by which we assess and interpret evidence. Data sonification allows us to 
better appreciate the multifaceted and multidimensional historical truths 
contained within the codification of the world into ones and zeroes. 


CONCLUSION: Listening Up 


Subjectivity is not merely the impure other of objectivity. 
— VEIT ERLMANN, Reason and Resonance: A History 


of Modern Aurality 


Moving between looking and listening by employing the tactics of digital 
image sonification advances conceptualizations of the digital humanities 
first outlined by visual theorist Johanna Drucker. She calls for the develop- 
ment of a “digital aesthetics” revolving around the concept of “speculative 
computing.” Drucker’s experiments at the University of Virginia’s SpecLab 
revealed a dynamic interplay between computational experimentation and 
humanistic interpretation, one that seeks to expand rather than reduce 
meaning by attending to the pliability and ductility of digital form. Because 
representational objects, texts, and modes of expression are not static but 
rather are malleable based on positionality and perception, digital human- 
ists, she contends, should avoid the “mathesis” of formal logic that is so 
prevalent in computer science. This approach, which seeks to totalize, uni- 
versalize, and instrumentalize knowledge and perception, “can be chal- 
lenged only by an equally authoritative tradition of aesthetic works and their 
basis in subjective forms of knowledge production.” Drucker proposes a far 
more critical, qualitative, and subjective method, one that seeks to harness 
computation for imaginative interpretation rather than submit the critical 
facility of the imagination to a regime of narrow-minded quantification. As 
she puts it, “Neither ‘works’ nor ‘forms’ are self-evident entities. They are 
emergent phenomena constituted by shifting forces and fields through pro- 
ductive acts of interpretation.” 5 

Drucker’s theoretical interventions remind us that historical evidence is 
never transparent. We must “read” it to interpret it. We must make sense 
of the data for it to be meaningful. Especially with cultural material, this 
reading can come to include not only looking but also listening more inten- 
sively and more experimentally. To transit between the visual and the aural 
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through their modularity as data becomes a futuristic way of journeying 
back into the past on speculative pathways. It is particularly powerful as a 
foray into the ephemeral past of events such as the Berkeley Folk Music Festi- 
val, where sonic and visual experiences intermingled to create an intangible 
cultural heritage worthy of scrutiny, yet easily rendered both invisible and 
silent. Digital image sonification becomes not so much an act of recovering as 
one of uncovering and discovering, which is to say identifying the multifaceted 
dimensions of historical experience. 

In the end, after all, sight and sound are both grounded in the more uni- 
fied experiences of sensory perception. As Jonathan Sterne points out, the 
separation of the senses into discrete modes is a historical phenomenon, 
grounded in Enlightenment thinking. The very assumption that humans 
have five distinct senses only emerged over time.” Rather than using the 
digital to extend and reify the separation of the senses further, we can use 
the flexible modularity of data to become more aware of the very history in 
which our senses are embedded." But image sonification does not return 
us to some McLuhaneque unification of the senses; rather, it transits synes- 
thetically between the optic and the aural in pursuit of meaningful explana- 
tions that arise out of the movement between the two through the mediating 
form of binary data.” As the auricular and the optic crisscross and enrich 
each other, a hybrid phenomenology—a way of perceiving—arises from 
careful attention to the ontology of digital materiality and points to what 
digital artifacts actually are on the material level. This approach brings us 
back to the rich sensorial immediacy of the past precisely by making use 
of its remediation—its alienation—into digital form. From there, we can 
produce new historical epistemologies, new ways of knowing not only what 
was happening but also why it mattered. 

In the digital humanities, we are only just beginning to explore the pos- 
sibilities of history writ in code. Like data visualization, image sonification 
offers one mode through which the field can push interpretation of the past 
forward.*° Image sonification echoes visualization’s focus on remediating 
and re-presenting data using the peculiarly modular qualities of binary code, 
but it also enters more uncertain territory by recalibrating the privileging 
of the optic over the aural in historical investigation. Digital technologies 
become a means for deepening comprehension not only of the visual past 
but also of what Sterne calls “the audible past.”*” Historians tend to be less 
confident about what they hear than what they see in the evidentiary record. 
As we enter the digital era, however, we must develop methods of accessing 
history through computationally mediated sources that let the noise of the 
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future into the previously muted chambers of archival research. Through 


digital image sonification, we can open our ears as well as our eyes to 


sound in order to picture the past more completely, more accurately, more 


profoundly. 


NOTES 
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The chapter title and epigraph are taken from Bob Dylan’s “It’s Alright Ma (I’m 
Only Bleeding),” on Bringing It All Back Home. 


For more on Chris Strachwitz, see Rohter, “Still the Address”; Benicewicz, 
“Chris Strachwitz”; and Gosling and Simon’s documentary film This Ain’t 

No Mouse Music. For more on Mac McCormick, see Lomax, “The Collector.” 
Strachwitz encountered Lipscomb while traveling through East Texas with fel- 
low folklorist Mac McCormick in search of the bluesman Sam John “Lightnin’” 
Hopkins, whom he had similarly helped to travel to California to perform at 
the Berkeley festival in 1960. Strachwitz also took a photograph of Lipscomb 
at the 1963 festival from almost the same vantage point as the image in the 
Berkeley archive. It can be viewed at the Arhoolie Foundation website, http:// 
arhoolie.org. Additionally, there is a wonderful and quite similar image in the 
Berkeley Folk Music Festival Collection of Lipscomb during his first appear- 
ance at the Greek Theater as part of the 1961 festival program. 

On the history of the Greek Amphitheater, see Hyman, “UC Berkeley’s Greek 
Theatre.” 

For more on Lipscomb, see Alyn, I Say Me for a Parable. 

Berkeley Folk Music Festival Collection, Northwestern University. 

Gibbs and Owens, “Hermeneutics of Data.” 

Bolter and Grusin, Remediation. See also Trettien, “Circuit-Bending Digital 
Humanities.” 

Indeed, what at first might seem like computational distortions—what digital 
literary scholars sometimes call deformances—can potentially lead to greater 
accuracy in our comprehension of the past. Mark Sample describes the term 
“deformance” as “a portmanteau that combines the words performance and 
deform into an interpretative concept premised upon deliberately misreading 
a text, for example, reading a poem backwards line-by-line.” See Sample, 
“Notes towards a Deformed Humanities.” Another digital literary scholar, 
Stephen Ramsay, puts it this way: “Computationally enacted textual trans- 
formations reveal themselves most clearly as self-consciously extreme forms 
of those hermeneutical procedures found in all interpretive acts [my italics].” See 
Ramsay, Reading Machines, xi. Deformance intersects with older operations 
that turn to stochastic methods to examine texts from new angles: everything 
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10 


11 


12 


13 


14 


from Emily Dickinson’s tantalizing concept of backward reading to Randall 
McLeod’s “transformissive reading” to the systematic word-substitution 
tactics of the Oulipo group. Moving beyond text alone, one might also include 
the Zen-inflected compositional ideas of John Cage or the choreographic 
approaches of Merce Cunningham. To be sure, the influence of Dada, surre- 
alism, and situationism lurks in deformance as well. See also McGann and 
Samuels, “Deformance and Interpretation”; Samuels, “If Meaning, Shaped 
Reading”; and Kramer’s “Navigating the ‘Screwmeneutic’ Circle” and “Dis- 
torting History.” 

On the history of photography, see Barthes, Camera Lucida; Sontag, On Photogra- 
phy; Olin, Touching Photographs; and Wells, Photography Reader. On the repre- 
sentational dimensions of archival sources, see Farge, Allure of the Archives, and 
Steedman, Dust. For an article on the historical archive in relation to digital 
history, see Darnton, “Good Way to Do History.” 

On the folk revival as a milieu of cultural mediation, see Filene, Romancing the 
Folk. 

See the essays in Gitelman, “Raw Data,” as well as Sterne’s work on formats in 
MP3. 

Jenkins, Convergence Culture. See also Galloway, Protocol, on the technical di- 
mensions of code that make the internet a mechanism of consolidation and 
control. 

On visualization, see, for instance, Moretti, Graphs, Maps, Trees; Stanford Uni- 
versity’s Spatial History Project; and Staley, Computers, Visualization, and History. 
The folk revival contains figures long interested in using technology to pivot 
between sound and sight, music and image. No less a figure than one of the 
founders of American ethnomusicology, Charles Seeger, father of folk-revival 
mainstays Pete and Mike Seeger and himself a frequent speaker at the Berkeley 
Folk Music Festival, supported the building of the first electronic music writer 
in the United States in 1956. The melograph, Seeger believed, might more 
accurately capture visually the sounds of world musics that did not translate 
well to classical Western notation. See Seeger, “Prescriptive and Descriptive,” 
148-95. On the melograph, see Pescatello, Charles Seeger, 212. The effort to no- 
tate sound is deeply connected to interest in “folk” and vernacular music; see 
Nettl, “I Can’t Say a Thing.” Thanks to Mary Caton Lingold for reminding me 
of this point and of Charles Seeger’s important role in expanding musical vi- 
sualizations beyond standard Western notation long before digital humanities 
scholars became obsessed with visualization. For more on technology and 
mediation in the folk revival, see Svec, “Folk Media,” “Pete Seeger’s Mediatized 
Folk,” and “IfI Had a Hammer.” 

For more on the folk revival’s history and the role of festivals within that his- 
tory, see Cohen, Rainbow Quest and History of Folk Music Festivals. See also Cant- 
well, When We Were Good; Filene, Romancing the Folk; Donaldson, “I Hear America 
Singing”; Lornell, Exploring American Folk Music; and the essays in Rosenberg, 


“A FOREIGN SOUND TO YOUR EAR” . 205 


15 
16 


17 


18 


19 


20 


21 
22 


23 


24 
25 


26 


206 : 


Transforming Tradition. DeWitt, Cajun and Zydeco Dance Music, offers a fascinating 
look at the legacy of the folk revival in Northern California during more recent 
decades. 

See Gibbs and Owens, “Hermeneutics of Data.” 

Documentarian Ken Burns garnered fame in part for his innovative technique 
of panning a movie camera across still images and photographs in his films. 
He often did so to a musical soundtrack. See The Civil War. 

The “constructionist” philosophy of the “maker movement,” with its produc- 
erist ethic of actively doing things with objects instead of passively observing 
them or merely critiquing them, has been influential in digital humanities. 
See Hatch, Maker Movement Manifesto; Donaldson, “Maker Movement”; and the 
website of the University of Victoria’s Maker Lab in the Humanities (accessed 
January 14, 2018, http://maker.uvic.ca). For critiques of the maker movement, 
see Chachra, “Why I Am Nota Maker”; and Morozov, “Making It.” 

The concept of “versioning” has begun to emerge as a key tactic in digital 
literary studies, but less so in digital history. See Kirschenbaum, “The .txtual 
Condition” and “Save As.” See also Manovich’s notion of “variability,” in Lan- 
guage of New Media, 36-45, and the UVic Maker Lab in the Humanities website 
article, “Versioning Modernism.” 

We are closer here to Bruno Latour’s “actor-network” theory, in which objects 
possess agency because of their positioning within an ever-evolving matrix of 
social relationships. See Latour, Reassembling the Social. 

Hart described his camera in an email correspondence with the author, 

May 30, 2017. On Freedom Summer, see McAdam, Freedom Summer, and Watson, 
Freedom Summer. On the Free Speech Movement at the University of California, 
see Cohen and Zelnik, Free Speech Movement, and Rorabaugh, Berkeley at War. 
Cantwell describes an image of Bob Dylan, Joan Baez, the Freedom Singers, 
and other folk luminaries holding hands and singing together at the closing 
1963 Newport Folk Festival in these terms; see When We Were Good, 19, 351-52. 
Hurt, “Mary, Don’t You Weep”; Watson, “Country Blues.” 

Audacity: Multi-Track Audio Editor and Recorder software (accessed Novem- 
ber 21, 2017, http://audacity.sourceforge.net). 

Hurt’s original track seems to have been recorded in stereo; Watson’s was re- 
corded in mono and then remastered as stereo for later re-releases. Both tracks 
reflect the folk-revival aesthetic of doing little technologically to manipulate 
the recorded sound. 

For more on Hurt’s life, see Ratcliffe, Mississippi John Hurt. 

In using this term, Iam linking Hurt to the scholarly literature on the African 
American trickster figure, particularly as a cultural innovation forged under 
duress due to racism, slavery, Jim Crow, and other oppressive conditions in the 
United States. See Baker, Blues, Ideology; Gates, Signifying Monkey; and Floyd, 
“African American Modernism.” 

For more on Watson’s life, see Gustavson, Blind but Now I See. 
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See, for instance, Beckert, Empire of Cotton, for a history of these cross-regional 
structural commonalities. On southern music and class, see Malone, Singing 
Cowboys and Don’t Get Above Your Raisin’. 

On the circulation of southern musical styles, see Miller, Segregating Sound. 

For Cage’s reflections on the use of chance operations in his compositional 
strategies, see Kostelanetz, Conversing with Cage. 

Shank, “‘That Wild Mercury Sound’”; see also Radano, Lying Up a Nation. 
Debates have raged among scholars about song style in the Mississippi 

Delta. Early blues scholars romanticized a more “primitive” and supposedly 
authentic, anticommercial style in the region; more recently, scholars such as 
Elijah Wald have pointed out that singers such as Robert Johnson performed 
in a wide range of styles that suited the desires of their audiences and reflected 
access to the range of twentieth-century American popular music; see Wald, 
Escaping the Delta. 

Barry Olivier, director of the Berkeley Folk Music Festival, described Hurt in 

a conversation as a leprechaun-like figure. Hurt’s manager, Boston-based 
photographer and folk music producer Dick Waterman, thought of him as 

the archetypal hippie; see Waterman, “John Hurt.” 

On glitching, see Krapp, Noise Channels. 

Cantwell, Bluegrass Breakdown. 

Thanks to Mary Caton Lingold for making this observation about the African 
American blues presence in Watson’s performance style. 

See chapter 9 of Gustavson, Blind but Now I See. 

White, “What Is Spatial History?” On mattering maps, see Grossberg, Dancing 
in Spite of Myself, 13. 

Quoted in Shubb, “Saturday Morning.” 

Manovich, Software Takes Command, 339, italics in original. 

Dylan, “Baby Let Me Follow You Down.” 

Gitelman, Always Already New. 

Tools of data sonification include the Photosounder application by Michel 
Rouzic (accessed November 21, 2017, http://photosounder.com) and TAPoR’s 
Voyant Bubbles software (accessed November 21, 2017, www.tapor.ca/?id=11). 
See also “Say It with Pictures”; and Davies, Cunningham, and Grout, “Visual 
Stimulus.” 

Computer programmer Bill Parod of the Northwestern University Information 
Technology division has been immensely helpful in conceptualizing and 
beginning to implement this idea. 

Gibbs and Owens, “Hermeneutics of Data.” 

Data sonification also raises fascinating questions about what counts as legiti- 
mate evidence. At one level, it distorts a photograph into a sonic form that is so 
removed from the original and so odd-sounding to the human ear that it might 
perhaps seem useless for inquiries into the past. Then again, sonified data is 
still linked to the original artifact; it merely remediates the data of the digital 
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image itself, which was already a remediation of a photograph, which in turn 
was a remediation of a past moment. 

Owens, “Glitching Files.” 

Reed, Metal Machine Music. The album’s four tracks, each precisely sixteen min- 
utes and one second long, consist of guitar feedback manipulated at various 
speeds by Reed. 

See “Photosounder Version 1.9 User Guide” (accessed January 14, 2018, http:// 
photosounder.com/documentation.php). Michel Rouzic provided further 
explanation in two emails to the author, January 21, 2015. 

Cantwell, Ethnomimesis. 

For analysis of “playing the folk,” see Hale, “Black as Folk”; see also Hamilton, 
In Search of the Blues. 

The use of sound to index large datasets has been the most common approach 
to sonification (and visualization, for that matter) in the digital humanities. 
See, for instance, fascinating projects such as Joque’s Listening to the Dow; 
Listen to Bitcoin by Laumeister; and Listen to Wikipedia by LaPorte and Hash- 
emi. A more adventurous version can be found in Foo’s ongoing Data-Driven 
DJ experiments. Of course, the sound of something like ten thousand banjo 
samples ringing out in unison seems like a wonderfully twisted thing to get to 
hear in its own right. 

Drucker, SpecLab, xiii, 17, 23. See also Drucker, “Humanities Approaches”; and 
Sayers, “New Poster.” 

Sterne, Audible Past; Erlmann, Reason and Resonance; Levin, Modernity and 
Hegemony. 

A variety of fields—visual culture studies, sound studies, and new media 
studies—have already begun to traverse the senses as historical forms. On 
visual culture studies, see Mitchell, Picture Theory and What Do Pictures Want? 
See also Sturken and Cartwright, Practices of Looking. For sound studies, see 
endnote 57 below. On new media studies, see Wardrip-Fruin and Montfort, 
New Media Studies Reader, and Giddings and Lister, New Media and Technocultures 
Reader. 

See McLuhan, Understanding Media and Medium Is the Massage. 

In this way, the practice of digital image sonification for historical interpre- 
tation offers a response to the call by archivists such as Bertram Lyons for 
computational scholarship to shift into a “post-digitization” phase. Rather 
than merely preserving artifacts digitally, we must start to figure out what 

we can do with them once they exist within a digital environment. See Lyons, 
“Editorial.” 

Sterne, Audible Past. The field of sound studies to which Sterne’s book belongs 
has already begun this project of recalibration. See books such as Corbin, 
Village Bells, and Smith, Listening to Nineteenth-Century America. For overviews, 
see Sterne, Sound Studies Reader, and Bull and Black, Auditory Cultures Reader. 
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AUGMENTING MUSICAL ARGUMENTS 


Interdisciplinary Publishing Platforms 


and Augmented Notes 


JOANNA SWAFFORD 


From the beginning of my PhD program, I knew that I wanted to examine 
the intersections of music and poetry. I quickly realized that print media 
was not the ideal format for that examination. When analyzing a musical 
setting of a Victorian poem for a final paper, I painstakingly included an- 
notated excerpts of a score in the appendix and a cD so that my professor 
could both see and hear the musical effects I was elucidating. Unfortunately, 
the professor was unable read music, so the score served no useful purpose, 
and he found it difficult and cumbersome to associate the musical passages 
I described in my essay with those on the cD. Without a way to immediately 
unite score and audio, I knew my arguments would continue to be unintel- 
ligible to my audience. Thanks to the training I received from Networked 
Infrastructure for Nineteenth-Century Electronic Scholarship (NINES) and 
the Scholars’ Lab digital humanities fellowships at the University of Vir- 
ginia, I began the process of building Augmented Notes, a tool to help make 
the highly specialized language of music accessible to nonmusicians. 
Before I started building my own tool, I first surveyed other solutions to 


this problem in publishing, both in print and online. In the 1960s and 70s 
ethnomusicologists often included LPs with their monographs so readers 
could hear the music the book described. In the 1980s musicologists often 
replaced vinyl with cassette tapes.” By the 1990s monographs and textbooks 
often included cps.’ However, these solutions require readers to go to the 
extra trouble of finding the exact measures of the song on the external audio 
files, and this additional step reduces the likelihood that anyone will actu- 
ally follow the argument by listening to the music. 

Recently, some monographs have started incorporating supplemental 
websites to better address this problem. The second edition of Mark Katz’s 
Capturing Sound: How Technology Has Changed Music replaced the first edition’s 
CD with a continuously updated website that includes the audio and video 
files mentioned in the book with cross-referenced page numbers.* While 
this website enables readers to hear the music and audio in question, it still 
does not help readers find the exact musical phrases mentioned in articles, 
and those with less musical expertise will be left out of the conversation 
entirely. 

Textbooks and print journals have followed suit: as a supplement to 
their anthologies of British literature, Broadview Press features a password- 
protected webpage that includes a section titled “Sounds of British Litera- 
ture,” which contains only recordings of sixteenth- and seventeenth-century 
songs. While it is vital for literary scholars to address musical settings of 
songs, it is equally important to provide the score as well as the audio. The 
Norton anthologies for music also have elaborate websites, which include 
“Listen For” tutorials. These tutorials have short videos for selected songs 
that feature one-sentence voiceovers explaining the importance of the ex- 
cerpt, followed by labeled annotated timelines of the score’s structure, which 
become filled by a black bar as the audio track progresses through the song. 
While this method provides a detailed, guided tour through portions of 
particular songs, it does not include images of the score itself, which makes 
it less useful for my purposes. The Journal of the American Musicological Society 
has perhaps the best model—when users click on an article with audio, the 
journal displays the score excerpt and plays the corresponding audio—but 
even this framework is limited: the journal is primarily distributed in print, 
and accessing the web framework, which is protected through a paywall, 
is cumbersome.’ Additionally, although the audio and score are presented 
together, the score is not highlighted in time with the audio: this omission 
is not a problem for musicologists (the primary audience for JAMS), but it 
would present a problem to readers who are not music specialists. 
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In recent years the digital sound studies community has produced a 
growing number of multimedia archives, but these generally opt to privilege 
either the score or the audio. For example, the English Broadside Ballad Ar- 
chive (EBBA) at the University of California, Santa Barbara, is bringing mu- 
sical settings to the fore by digitizing almost eight thousand ballads from 
England, and it includes facsimiles, transcriptions, and, when available, 
audio recordings of the ballads.’ It also contains some essays and visualiza- 
tions (including graphs and maps) of different aspects of the songs, making 
it an excellent resource that furthers the goals of sound studies. However, 
since printed ballads often included only the words and not the scores, this 
site reproduces that publishing strategy, sidestepping the problems inherent 
in making musical scores legible to nonmusicians.*® 

Recently, scholars and programmers have tried to address this problem 
by finding new publishing strategies to incorporate music in academic ar- 
ticles, as SoundCite and Scalar have demonstrated.’ SoundCite is a tool that 
lets users embed sound clips in websites by following three easy steps. It en- 
ables users to place the audio file in line with the text, and even overlapping 
with it, so that clicking on a phrase will begin playing an audio file of that 
phrase. This tool is incredibly useful for publishing articles online if users 
are only concerned with linking audio to text, but it does not support link- 
ing audio to score images, and it sometimes glitches on mobile devices and 
when used with WordPress. Scalar is a publishing framework that lets users 
annotate media and superimpose those annotations, so users can add links 
and text to appear in any audio or video file. Again, however, users cannot 
synchronize an audio file and score, so any included scores will still be il- 
legible to nonmusicians. Other attempted strategies include interactive CDs 
designed to guide newcomers to classical music through some canonical 
works, MIDI plug-ins for web browsers, and flash-based animated scores.’° 
Some musicology periodicals have opted for an exclusively digital form to 
embed MP3s or YouTube videos into their analyses.” However, none of these 
projects feature good-quality audio integrated with a score, and many rely 
on outdated technology. The other popular option involves using video- 
editing software to create short film clips by manually synching scores with 
audio files and then posting the clips on YouTube as animated scores. While 
this strategy can produce an end result similar to what I had envisioned, 
video-editing software can be quite expensive and cumbersome, and I was 
looking for a tool designed to bring score and sound together, rather than 
one that could be rigged to do the job. 

After surveying the available digital tools and projects, I concluded that 
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nothing existed that suited my needs: I wanted to build a new publishing 
framework to combine audio, score, and analytical commentary in which 
every measure of a score would be highlighted in time with the music from 
an audio file. I was fortunate to have been a member of the first Praxis Pro- 
gram cohort with the Scholars’ Lab at the University of Virginia, a graduate 
fellows program that gives students an intensive education in digital hu- 
manities. From that experience, I learned enough programming and basic 
web development to build Songs of the Victorians, an archive and analysis 
of Victorian song settings of contemporaneous poems.” Each archive page 
includes a recording ofa Victorian song synced with its first-edition printing 
so that every measure of the song is highlighted in time with the music. 
Songs of the Victorians also has article-length analyses of these songs, 
which explain how the musical settings function as interpretations of their 
lyrics. The articles use fragments of these integrated scores as excerpts to 
support my analyses of the gender politics of each song: wherever I elucidate 
a phrase of the song, I supplement the analysis with a hyperlink (a speaker 
icon) that, when clicked, reveals the corresponding excerpt in which the 
score is highlighted in time with the audio. For example, when discussing 
political activist, marriage reformer, and composer Caroline Norton’s best- 
selling song “Juanita” (1853), I use this excerpting framework to show how 
a musical allusion makes the song into a subtle critique of marriage rather 
than an endorsement of it. The melody for the first four bars of the chorus 
(on the words “Nita, Juanita, Ask thy soul if we should part”) is the same 
as the melody from Handel’s aria “Lascia ch’io pianga” from the opera Ri- 
naldo (1711), in which an imprisoned woman laments her fate and dreams 
of freedom. I use the excerpting framework to play the Handel excerpt and 
Norton excerpt side by side so users can hear the similarities and then more 
readily believe my argument: that Norton used this allusion to suggest that 
marriage is a type of imprisonment and that Juanita, like Norton herself, 
wishes for freedom from a husband. 

This framework made possible my interdisciplinary scholarship: without 
Songs of the Victorians, I would have been unable to convince my readers 
that women musicians could use these disarmingly simple songs, often per- 
formed in the parlor as part of a courtship ritual, to unsettle the gendered 
status quo, from queering the heteronormative space of the parlor to taking 
greater agency in courtship to critiquing marriage laws. This digital pub- 
lishing framework enables literary scholars without musical experience to 
follow arguments that, when presented simply as musical notes printed ona 
page, were completely inaccessible. It has also been invaluable in conference 
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FIGURE 9.1 Box-drawing page of Augmented Notes. 


presentations: multiple scholars have informed me that they had previously 
been intimidated by interdisciplinary arguments involving music, but the 
highlighting framework gave them new confidence in and understanding 
of such arguments. 

The framework was so popular that I had requests to build similar sites 
for other scholars’ conference presentations, archives, books, and articles. 
As I could not build customized sites for everyone, I created Augmented 
Notes, a generalized public humanities tool that allows users to integrate 
an audio file with a score to use in both academic arguments and digital ar- 
chives. Augmented Notes takes audio files and score images and combines 
them into webpages where each measure of the score is highlighted in time 
with the audio so that everyone, regardless of musical literacy, can follow 
along. It is simple to use and eliminates the need for users to understand 
programming. After uploading audio and image files, users are taken to a 
page where they click and drag to draw boxes around each measure. Users 
can change the size and position, numbering, and alignment of boxes (or 
delete them, as well). Once the entire score has been appropriately high- 
lighted, users can proceed to the time editing page. 
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FIGURE 9.2 Time-editing page of Augmented Notes. 


On the time editing page, users annotate each measure with the time 
when that measure ends in the audio: here, a scholar listens while the au- 
dio plays and hits a button as the audio reaches the end of each measure, 
thus marking the measure boundaries, which records the timestamp in the 
input boxes on the right-hand side of the screen. Users continue recording 
timestamps until the entire score has been processed. They can edit any of 
the timestamps, jump forward and backward by measure, and go back to 
the start to observe whether they properly aligned the audio with the score. 
Once the user is satisfied with the measure locations and times, Augmented 
Notes exports the measure and time information necessary to highlight 
each measure of the song in time with the music. Users then download a 
zip file with the HTML, Css, and JavaScript files necessary for an integrated 
archive page, which they can then restyle themselves. 

Augmented Notes also has a sandbox where users who would like to ex- 
periment with the technology but do not themselves have the requisite files 
can try itout.” This demo page includes the score and audio to Bach’s Prelude 
No. 1 in C major (Bwv 846). This song perfectly encapsulates Augmented 
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Notes, because the score and audio are in the public domain (echoing the 
tool’s open-source policies) and also because this piece opens Bach’s Das 
Wohltemperierte Klavier, an influential series of keyboard pieces composed 
to show off the advantages of a new system of keyboard tuning. Since Das 
Wohltemperierte Klavier was Bach’s attempt to unite the written and the aural 
while using a new technology, it nicely parallels the purpose of Augmented 
Notes, which is also a new system for combining the written and the aural. 
Augmented Notes is already being used by scholars for archival projects, 
such as Romantic-Era Lyrics from the University of South Carolina and 
Sounding Tennyson from the University of Cambridge. It also has peda- 
gogical uses: professors can use the interactive scores to teach or test basic 
score-following in music appreciation classrooms or to highlight particular 
motives buried in orchestral scores in more advanced classes. Because it is 
free, open source, and usable by anyone with computer access, scores, and 
audio files, it can preserve any musical cultural record and can be used for 
scholarly or nonscholarly purposes. It was voted first runner-up in the DH 
awards 2013 competition in the “best DH tool or suite of tools” category.” 
Iam currently designing options for greater user customization: specif- 
ically, I want to support highlighting musical units other than measures 
(including individual notes) and to allow users to draw shapes other than 
rectangles around the music. Additionally, I plan to build greater support 
for MEI (Music Encoding Initiative). Developed by Perry Roland at the Uni- 
versity of Virginia, MEI is a type of XML for the scholarly encoding of music, 
just as TEI is designed for the scholarly encoding of text.” It is quickly be- 
coming the standard markup for scholarly digital editions of scores. With 
MEI scholars can encode a measure of music in a method similar to encod- 
ing a section of a poem in TEI: they can mark up the measure, staff, chord 
duration, notes, and instrumentation as one might mark up a stanza, lines 
within a stanza, the rhyme scheme, and the speaker. Although Augmented 
Notes can import bar line positions and timestamps from MEI, it does not 
yet export MEI, and this additional functionality would increase the tool’s 
interoperability and usefulness in the greater digital sound studies com- 
munity. For instance, MEI capabilities would let me partner with Edirom, a 
music editor that enables the collation of music marked up in MEI so that 
users can easily compare multiple performances of the same song. 
Although currently the site only produces archive pages, I am expanding 
its functionality to accommodate an excerpting framework. After syncing 
the score with the audio, users will be able to select the starting and ending 
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points for different excerpts and the caption for these excerpts. The output 
will include a second HTML file that contains the excerpts, labeled and listed 
in order, onto which users can add the surrounding analytical text. I have 
already used this strategy in Songs of the Victorians: when the commentary 
discusses a particular measure, the users can click on an icon ofa speaker to 
highlight the relevant measures of the score in time with the audio so they 
can hear for themselves the effect the commentary describes. 

Iwas able to learn the HTML, Css, and JavaScript necessary for Augmented 
Notes only because of my graduate school training. I became a fellow with 
NINES early in my PhD program, during which I learned TEI and the im- 
portance of archives and developed enough basic web development skills to 
build the prototype for Songs of the Victorians. NINES granted me a schol- 
arship to attend the Digital Humanities Summer Institute (DHSI), where I 
took “Multimedia: Design for Visual, Auditory, and Interactive Electronic 
Environments,” an intensive weeklong training program that prepared me 
for my next experience: I was one of six students in the first Praxis Program 
cohort at the Scholars’ Lab at the University of Virginia. We had weekly 
meetings in which we learned best practices of digital humanities, includ- 
ing designating credit, drafting project charters, project management, web 
design, and basic programming. We worked closely with the Scholars’ Lab 
staff, and each Praxis student developed specialties—including coding, 
design, and project management—in addition to expanding our generalist 
knowledge, ensuring that the developers could communicate clearly with 
the designers at all times. We were also an interdisciplinary group, so we 
gained experience collaborating with others outside our academic fields. 
Over the course of the year, we worked together to build a tool—Prism—for 
analyzing and comparing crowdsourced interpretations of text, and the fol- 
lowing year the Praxis cohort added to it. As lead developer on the project, 
I got a crash course in JavaScript and CoffeeScript, which helped me refine 
the code underlying Songs of the Victorians, and my newfound knowledge 
of best design practices inspired me to completely redo the interface for the 
site. It was during that year that I came up with the idea for Augmented 
Notes, and the project management skills I acquired during Praxis enabled 
me to break the project into its smaller components and stay on task build- 
ing it during my year as a Scholars’ Lab fellow. 

The fellows program enables up to three students each year to work 
closely with the Scholars’ Lab staff on a research project of their choice and 
pays enough to reduce their teaching loads for at least a semester so they 
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can focus on completing the project by the end of the year. With the advice 
and training of the Scholars’ Lab, I further revamped Songs of the Victo- 
rians and created Augmented Notes. The three fellowship programs gave 
me the support, knowledge, and funding required for my project: without 
their help, I would have been unable to build my site and therefore unable to 
pursue my dissertation topic. Since I was writing a full-length dissertation 
in addition to building two digital projects, their support was particularly 
invaluable. Because their support enabled me to build my interdisciplinary 
projects, it also led first to my junior faculty position as Assistant Professor 
of Interdisciplinary and Digital Teaching and Scholarship at suNy New 
Paltz, and later, to my position as the Digital Humanities Specialist at Tufts 
University. Augmented Notes, and graduate training in digital humanities 
more generally, truly shaped my career trajectory. 

As my own history shows, new media enable new arguments: without 
Augmented Notes to unite audio with score, I would have had to abandon 
my arguments about performances of Victorian songs, as my ideas needed 
a new structure that incorporated sound to be legible to nonspecialists. In 
fact, given the rise of digital publishing options for sound studies, evidenced 
not only by this collection but also by the rise of companion websites for 
textbooks and monographs and other standalone websites and tools, it is 
not a surprise that sound studies is experiencing a resurgence. However, as 
more publishers begin to explore options for digitally representing sound, 
we must make sure that the digital tools that make such work possible are 
not limited to people with the prestige and clout to access them: rather, we 
should continue to produce and improve the open-source and open-access 
tools that make our scholarship possible for everyone, from graduate stu- 
dents and independent scholars to endowed chairs. Since our scholarship 
is often limited by our technology’s ability to represent the art we analyze, 
we must continue to challenge our current publishing models to create the 
scholarship our art deserves. 


NOTES 


1 Sogard Jorgensen’s Qavaat and Edstr6m’s Sdmisk musik are just two examples of 
this trend. 

2 For example, musicologist Nicholas Temperley’s special edition of Victorian 
Studies included a cassette tape with the songs discussed in the articles. 
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This common technique is seen in such works as Rice’s May It Fill Your Soul, 
Watkins’s Proof through the Night, and Turino’s Music as Social Life. 

Hosted by University of California Press, the companion website for Katz’s 
book is at www.ucpress.edu/go/capturingsound. 

Pinch and Bijsterveld’s The Oxford Handbook of Sound Studies also has a com- 
panion website with links to websites, Mp3 files, and YouTube videos that are 
referenced in the text, but they do not include any transcriptions or scores; 
Boretz, Morris, and Rahn’s Perspectives of New Music also includes a digital 
appendix. 

Saavedra, “Carlos Chavez’s Polysemic Style.” 

English Broadside Ballad Archive. 

Douglass and Burwick’s Romantic-Era Songs project, which contains popular 
settings of Romantic poems, adopts a similar strategy: it includes introductory 
materials for each song or set of songs, audio files (MP3s), and the occasional 
transcription of the words, but the omission of scores hampers a truly inter- 
disciplinary analysis. 

SoundCite, from Northwestern University Knight Lab (accessed February 28, 
2015, http://soundcite.knightlab.com); and Scalar, from the University of 
Southern California (accessed February 28, 2015, http://scalar.usc.edu/scalar). 
MIDI Sheet Music (accessed November 27, 2017, http://sourceforge.net/p/ 
midisheetmusic/wiki/Home) and Sibelius Scorch (accessed February 28, 2015, 
www.sibelius.com/products/scorch/index.html) are MIDI-based, whereas 
Variations, developed at Indiana University (accessed February 28, 2015, http:// 
variations.indiana.edu/use/index.htm]), is the most sophisticated flash-based 
approach. 

For example, Inbhear: Journal of Irish Music and Dance (accessed February 28, 2015, 
www.irishworldacademy.ie/inbhear) and Echo: A Music-Centered Journal (accessed 
February 28, 2015, www.echo.ucla.edu) incorporate MP3s and videos. 

You can visit the website at www.songsofthevictorians.com. 

See Augmented Notes: A Tool for Producing Interdisciplinary Music and Text 
Scholarship (accessed November 27, 2017, www.augmentednotes.com). 

For the sandbox, see www.augmentednotes.com/example. 

“Digital Humanities Awards.” 

For more on MEI, see McIntire Department of Music: Music Encoding 
Initiative (accessed November 27, 2017, http://music.virginia.edu/mei). MEI’s 
better-known counterpart, MusicXML, is another XML for music designed 
mainly for formatting music in composition programs such as Sibelius 
(accessed November 27, 2017, www.avid.com/sibelius) and Finale (accessed 
November 27, 2017, www.finalemusic.com). MEI enables scholars to show 
“areas where multiple readings or realizations of the musical content—drawn 
from different sources—are possible, or encode information indicating that 

a different hand was used to write a section, or even a particular symbol, of 

a manuscript. Multiple media may also be related to the encoding, providing 
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methods of associating audio recordings or scanned images with the musical 
content.” Roland, Hankinson, and Pugin, “Early Music and the Music Encod- 
ing Initiative,” 610. 
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DIGITAL APPROACHES TO 
HISTORICAL ACOUSTEMOLOGIES 


Replication and Reenactment 


REBECCA DOWD GEOFFROY-SCHWINDEN 


In Paris, on the first Wednesday of every month, air raid siren tests blare 
from noon to 12:10. Goose bumps cover my arms every time I hear this 
sound. A complex set of experiences and knowledge causes my body to re- 
spond in such a way: the historical knowledge of World War II, an under- 
standing of the siren tests’ cultural context, a personal relationship with a 
man who grew up in Paris during the war, my imagination of living under 
the threat of bombings, and my current fear of terrorism. I grew up in a 
small town of two thousand residents in northeastern Pennsylvania, where 
every night at nine a fire siren wails, sounding remarkably similar to the Pa- 
risian air raid siren. Yet this Pennsylvania siren evokes quite a different re- 
sponse from me. As a child, upon hearing it I would drop whatever occupied 
me at the moment, race to the staircase of my home, and proceed to play 
“race-you-upstairs” against my mother. The comforting nine o’clock whis- 
tle signaled bedtime through a combination of family tradition and local 
timekeeping. It still conjures in me an emotional sense of safety and love. 
Despite the material similarity of these two siren sounds, it is a distinct set 


of historical, cultural, local, and personal meanings that grants each its 
discrete significance. 

Humans experience sound through a complex set of physical, psycho- 
logical, emotional, and affective processes. The siren sound is not merely 
an acoustic phenomenon; it is also a portion of my sonic knowledge, an in- 
ternalized admixture of sensory experiences and subjective interpretations. 
As listeners bounce new sounds off past experiences to (re)create meaning, 
they simultaneously establish personal archives of sonic knowledge and a 
collective, social archive, as well. I was surprised to find that a quick Google 
search of “Paris air raid sirens” yields dozens of reflections on this aural 
experience, particularly by nonnative Parisians, who share my affective 
reaction to the eerie sound. This relational process of listening and hearing 
underlies what ethnomusicologist Steven Feld has called acoustemologies, 
or acoustic epistemologies: “the agency of knowing the world through 
sound.”* Feld continually highlights how sensuous local knowledge consti- 
tutes acoustemologies; he writes, “The world sonified is the world known, 
the world felt, the world performed.”* Humans know, feel, and perform the 
world in historically and culturally specific ways, in both individual and 
collective capacities. 

The growth of sound studies has fueled an initiative to approach the 
distant past through sound. Scholarship across disciplines has begun to 
investigate how a sonic framework can reveal new insights into history. 
The first step to this research is often a material reconstruction of historical 
soundscapes, and scholars have turned toward digital technologies to repli- 
cate a diversity of sounds that until recently were considered lost.? Currently, 
this digital methodology tends to stop at the material. Scholars of audible 
history have hardly experimented with the soft side of digital media, which 
offers promising formats to exhibit the meanings that have been attached to 
sounds throughout history. Digital approaches to these more subjective fac- 
ets of sound might transform acoustic reconstructions from distant sonic 
artifacts to intimate sonic experiences, and also challenge how scholars 
traditionally present their primary and archival sources. Digital formats not 
only simulate the process by which sentient beings constitute acoustemol- 
ogies in everyday life, but they can also uncover the methodological and 
theoretical implications of academic publication formats. A turn to diverse 
media in the presentation of audible history will encourage a vital rethink- 
ing of the performance of archival research as well as scholarly production 
and reception. This turn might force scholars to rethink the underlying 
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assumptions of their work, while also inviting broader audiences into the 
reenactment of historical acoustemologies. 


Recording, Recovery, Replication, Reenactment 


Despite its lack of sound recordings, the pre-recording-technology ar- 
chive does not lack a historical record of sound.* Like Eugene Smith’s ever- 
running loft tape, brittle documents, chipped objects, and crumbling archi- 
tecture uniquely capture sound as a testament to life, life that sounded even 
before mechanical reproduction could fully capture it. But accusations of in- 
authenticity and anachronism may await digital projects representing such 
artifacts through twenty-first-century technologies. Past debates within his- 
tory and musicology, two of audible history’s parent fields, forewarn such 
scholarly derision. A prevalent distrust of reenactment—the re-creation of 
historical events in the present—pervades the discipline of history, where 
the practice has a popular rather than critical connotation.’ Conversely, 
the field of music known as historically informed performance (HIP) uses 
period instruments, past performance techniques, and contemporaneous 
treatises to re-create in minute detail historically accurate performances of 
pre-recording-technology compositions. After disciplinary growing pains 
in the 1980s and 1999s, critics today rarely bother to condemn the authentic- 
ity of HIP scholars’ research, which is generally considered, at least among 
musicologists, as commensurate to a historian interpreting archival docu- 
ments and artifacts. Somehow, historical performance practitioners dodge 
the lowbrow label of musicological “reenactors.” The predecessors of au- 
dible history, history and musicology, have the potential to cast a shadow 
over still-nascent digital approaches to the field. Although an entire subdis- 
cipline of music is dedicated to the precise replication of historical music, 
the re-creation of sound more generally might amount to mere philistine 
reenactment. Lest we forget, the other roots of audible history, by way of 
sound studies, are grounded in anthropology and ethnomusicology, the two 
closely related disciplines that gave birth to Feld’s concept of acoustemol- 
ogies. The dependence of anthropology and ethnomusicology on field re- 
cordings engenders sound as a serious object of study and mode of analysis. 
This intellectual breakthrough is unlikely to have taken place without the 
possibility of recording technology, just as HIP’s obsession with historically 
faithful performances is unlikely to have developed without the possibility 
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of infinitely repeatable musical recordings. Technology that has facilitated 
such fruitful methods should not be dismissed as somehow foreign to his- 
torical research.’ 

Nonetheless, methods of audible history that privilege recording technol- 
ogy inappropriately would indeed emphasize the twenty-first-century values 
that equate sound preservation with physical capture. Nonsonic media pro- 
vide alternative modes of listening and hearing that might produce fresh 
perspectives and complement the points of audition located in speakers or 
headphones. Rather than favor any one technology to re-create so-called 
authentic sounds, an acknowledgment of how all technologies mediate 
sound—from musical notation to MP3s—will prove more generative. A crit- 
ical stance toward the role of recording in audible history does not preclude 
digital methods; to the contrary, it calls for them. Digital methods grant 
diverse means of interaction with historical materials through formats that 
simulate how auditioning subjects acquired sonic knowledge in the past. 
The mobilization of diverse media in the pursuit of historical sounds will 
open up the possibilities of the pre-recording-technology archive, just as 
recording technology revolutionized research in anthropology, ethnomusi- 
cology, and musicology. 

A lack of traditional sonic records such as field recordings in the archive 
inevitably concerns scholars of digital audible history. Earwitness accounts 
provide a bulk of pre-recording-technology sources, including reports of 
complaints about noise, writings by travelers who recount new acoustic 
surroundings, and descriptions of musical performances and other sonic 
events. Earwitnesses not only provide descriptive source material but also 
explanations of how people listened to and interpreted sound. Images, too, 
offer vital sources and interpretations of sound, depicting objects, technol- 
ogies, spaces, and living beings that all contributed to the acoustics and 
soundscape of a particular time and place. Contemporaneous material cul- 
ture and architecture contribute vital information for the recovery of sound- 
scapes through acoustic and architectural modeling. Scholars of audible 
history may feel anxiety about the forms their sources take in comparison 
to sound recordings; even so, they boast a trove of evidence from which to 
recover ostensibly lost sounds. 
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Acoustics, Soundscapes, Audition 


Similar to its textual counterpart, digital audible history scholarship tends 
to fall within three overlapping categories: acoustics, soundscapes, and 
audition. The three categories build on one another, with soundscapes 
serving as a vertex where scientific acoustics and subjective audition meet. 
Acoustics reconstruct the sound of historical spaces quite accurately with 
the help of acoustic and architectural modeling, while soundscapes push 
beyond acoustics to include the objects and beings that populate historical 
spaces. Audition then incorporates not only histories of listening but also 
histories of the corporeality of hearing and the cerebral processes by which 
humans attach meaning to sound.® In the footsteps of R. Murray Schafer, 
who first articulated the concept of historical earwitness accounts, schol- 
ars have built on his work to consider the subjectivity of such sources—like 
my opening anecdote—and by extension, the subjectivity of the auditory.° 
Of course, the two avenues of sounding environment and auditioning sub- 
ject are rarely discrete, and the most compelling audible histories often lie 
at their intersection.’ The distinction between acoustic space as material 
and quantifiable and soundscape as listener-centric has been refined in the 
field of archaeoacoustics, which generally considers acoustic space as an 
entity that can be modeled and analyzed and soundscape as constructed, at 
least in part, through listeners’ experiences.” Thus, although soundscapes 
can be partially reconstructed through acoustics, the listener’s agency in 
the constitution of soundscapes remains crucial—an assertion that rests at 
the heart of Feld’s definition of acoustemologies, as well. A brief review of 
two digital audible history projects illustrates these generalizations about 
the nascent field. 

English professor John N. Wall led the cross-disciplinary team of re- 
searchers (from North Carolina State University; Cambridge, Massachu- 
setts; and London) who created the Virtual Paul’s Cross Project, “A Digital 
Re-creation of John Donne’s Gunpowder Day Sermon.” The team used 
architectural modeling and acoustic simulation software to reconstruct the 
performance of John Donne’s Gunpowder Day sermon, which was sched- 
uled to take place at the St. Paul’s Cathedral Churchyard on November 5, 
1622, but took place indoors instead due to inclement weather.” Using dig- 
ital tools typically employed to predict how sound will interact with space, 
the Virtual Paul’s Cross Project combines architectural, environmental, 
performative, and social factors to reconstruct the experience of Donne’s 
famous speech. In addition to considering the architectural and acoustic 
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features of the churchyard space, project participants also worked closely 
with experts on seventeenth-century oration and John Donne. The project 
culminated with an installation at the North Carolina State campus in 
Raleigh, which immersed visitors in a 270-degree, wraparound image of 
St. Paul’s Churchyard, as reconstructed by visualization software, while 
audio clips from twenty-one speakers broadcast what listeners might have 
experienced during Donne’s outdoor sermons. Because the churchyard was 
later destroyed by fire in 1666 and the speech never took place outdoors, the 
project replicates the performance context as it could have been rather than 
as a precise replica of a sonic event from history. This approach evades the 
issue of historical authenticity and shifts focus instead to acoustic factors 
in the reception of an improvisational performance genre that existed be- 
fore recording technology. The team specifically chose the Gunpowder Day 
sermon because it is one of the few Donne sermons to be transcribed soon 
after its delivery. The project goal was not to perfectly replicate a specific 
Donne speech but to synthesize acoustic and historical evidence toward a 
replication of the seventeenth-century London soundscape in which listen- 
ers experienced Donne’s many sermons. 

The project website offers practical, methodological, and theoretical con- 
siderations that informed the team’s research, as well as sample audiovisual 
clips from the installation. The clips place visitors in eight different points 
of audition throughout the churchyard and feature varying crowd sizes from 
five hundred to five thousand listeners. For example, site visitors can choose 
to experience how the sermon would have sounded from behind the preach- 
ing station in a crowd of twelve hundred people. Along with the speech read 
by a specialist of seventeenth-century oration, listeners hear crowd noise, 
birdcalls, and dogs barking—the acoustic environment that might have 
surrounded Donne’s performances and that would have constituted the 
acoustic environment of courtyard sermons. The website contextualizes 
this soundscape through textual descriptions of seventeenth-century ser- 
mon practices, Donne’s personal style of speech delivery, and the historical 
and political climate of the Gunpowder Day sermon. 

This project contributes an intellectually rigorous reconstruction of a 
historical soundscape to the field of digital audible history and achieves a 
variety of scholarly goals. The project creators summarize the outcomes 
of their endeavor as a reestablishment of the relationship between lost 
structures and spaces, a presentation of quantitative information that cor- 
rects interpretive earwitness accounts, a simulation of how a nonrecorded 
performance took place in space through time, and a demonstration of how 
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place and space affect both communication and performance.” The project 
coordinators conclude that the final product has made “the Paul’s Cross ser- 
mon the subject of reflection precisely as a situated experience, a communal 
and participatory experience, unfolding interactively in real time and in a 
specific place, under specific conditions of weather, season, and urban envi- 
ronment.”* Ideally, this would be the accomplishment of any digital audible 
history endeavor—to use sound as a way to historically and culturally situate 
a sonic experience or context for modern listeners. 

The challenge remains to bring modern listeners into this experience as 
active earwitnesses to the courtyard sermons. Indeed, the project website 
admits that the installation presents only one side of an interactive histori- 
cal performance, and the project’s insistence on “correcting” seventeenth- 
century accounts seems to distrust the experience conveyed by earwitnesses. 
Research on oration practices and acoustics permits an informed replica 
of Donne’s sermon soundscape; however, a reenactment approach to the 
soundscape would further guide modern listeners to consider the historical 
auditioning subject within the replication. The “Donne Interacting” page 
of the project website begins to work toward such engagement through 
descriptions of how Donne would have interacted with his audience, as well 
as how particular aspects of his speech and its acoustic context would have 
stimulated audience participation.’® Although the project team considers 
the demonstration of how the sermon unfolded “interactively” as one of its 
achievements, the form of the Virtual Paul’s Cross Project prompts twenty- 
first-century listeners to passively absorb seventeenth-century audition 
through textual marginalia rather than active sensory engagement. 

Historian Emily Thompson’s “The Roaring Twenties: An Interactive Ex- 
ploration of the Historical Soundscape of New York City” offers an example 
of how digital audible history scholarship might encourage modern listeners 
to actively engage with historical audition.” The online project presents pri- 
mary sources and archival materials about noise complaints and violations 
in early-twentieth-century New York City. The historical materials include 
everything from official noise complaints submitted to city governance to 
newsreels that portray the cacophonous New York City soundscape. Since 
recording technologies were at the cusp of booming during this period, the 
project also includes some contemporaneous films and sound recordings, 
although most materials are textual. Historical documentation of what New 
Yorkers considered noise—a contingent social category—situates these 
auditioning subjects in their historical acoustemology. In contrast to the 
Virtual Paul’s Cross Project, which emphasizes the replication of a sound- 
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scape, “The Roaring Twenties” focuses primarily on how people heard, 
interpreted, contributed to, and reacted to their local soundscape. 

Although Thompson’s project is rooted in an era during which recording 
technology began to flourish, it offers insight into potential digital ap- 
proaches to pre-recording-technology archives. The design of the project, 
produced in collaboration with web designer Scott Mahoney, offers three 
modes to explore the historical materials gathered by Thompson: sound, 
space, and time. Through the “sound” mode, visitors can sift through the 
materials categorically by types of sound: for example, sounds of traffic, 
transportation, or the home. If visitors choose to engage the materials 
through “space,” the documents and clips appear charted on a 1933 map of 
New York City. Through “time,” the materials are plotted chronologically 
on a timeline. Online visitors can choose their preferred mode to navigate 
through Thompson’s vast amount of historical materials, or they can engage 
the materials from a variety of perspectives—categorically, spatially, and 
temporally—to acclimatize themselves to the acoustemology of 1920s New 
York City. The materials presented in the digital project were presented in 
a more traditional academic format in Thompson’s book The Soundscape of 
Modernity.** Rather than interpreting materials for a reader and presenting 
them in a predetermined, written format, the digital project grants vis- 
itors the agency to choose an approach and to participate in the work of 
historicizing sound. By implicating the visitor in both the replication and 
reenactment of sonic artifacts, Thompson achieves a sophisticated balance 
among acoustics, soundscapes, and audition that does not excessively 
depend on recordings. Unlike the Virtual Paul’s Cross Project, which fore- 
grounds replication, Thompson’s approach insists upon the historicization 
of sound. Digital audible history here is not merely a replication of sounds 
but also a reanimation of historical acoustemologies. The online format 
grants modern listeners an opportunity to explore materials that attest to 
audition, mimicking the experiential, nonlinear process by which humans 
accrue sonic knowledge in reality. As social practices, hearing and listening 
are constituted across two axes—physical experience of material reality and 
psychological interpretation of those physical experiences.” In dialogue, 
the Virtual Paul’s Cross Project and “The Roaring Twenties” exemplify how 
digital audible history can transform historical audition for modern listen- 
ers from a mere sonic event into a sonic experience through both replication 
and reenactment. 
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Digital Approaches to Historical Acoustemologies 


My contribution to the web collection “Provoke!, Organs of the Soul: Sonic 
Networks in Eighteenth-Century Paris” takes an audition-focused approach 
to digital audible history.” Published on Scalar, a born-digital, open-access 
scholarly publishing platform, “Organs of the Soul” connects descriptions, 
depictions, and transcriptions of sound found in archival and primary 
source documents from eighteenth-century Paris through thematic nar- 
rative pathways and subject tags. Visitors can choose to follow the paths 
“voice,” “music,” or “sound” throughout the project, or they can browse 
materials by more detailed tags, such as Encyclopédie, Rousseau, or popu- 
lar song. The project streamlines diverse media on eighteenth-century 
Paris available across the internet—from digitized document collections 
on scholarly websites such as Gallica to musical recordings and videos on 
social media like YouTube. Connections among these sonic artifacts aim to 
demonstrate how sound performed, transmitted, and created knowledge in 
eighteenth-century Paris. Many of the pages are narrated in my own voice to 
make transparent the position of historians as only one of many mediators 
in the construction of audible history and to bring audition from textual 
marginalia and into the haptic experience of the project. 

By allowing sonic artifacts to interact with one another, “Organs of the 
Soul,” like “The Roaring Twenties,” attempts to re-create a web of sonic 
knowledge that would have constituted the historical acoustemology of 
auditioning subjects in eighteenth-century Paris. The “Organs of the Soul” 
paths begin with excerpts from the Encyclopédie, a contemporaneous publica- 
tion that offers widely accepted definitions of various subjects in eighteenth- 
century France. To imagine the sound of a voice through eighteenth-century 
French ears, one must first understand how contemporaries would have 
defined it, and so the voice path, for example, begins with a mid-eighteenth- 
century French definition of voice. The project reveals how many definitions 
of “voice” coexisted during this period, including a firm distinction between 
“the people’s voice” (a consensus) versus “the public voice” (inarticulate 
noise of the masses). This information nuances our understanding of an 
earwitness account that describes a swelling public voice. Although our 
twenty-first-century sensibilities might interpret such a description as a 
positive, democratic sentiment, the Encyclopédie definition elucidates that 
the phrase actually describes popular complaints as insignificant babble. 

It is challenging to convey the historical and cultural specificity of sonic 
experience in a way that invites audiences to actively engage with sound- 
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scape replicas. The siren anecdote that opens this chapter demonstrates 
the necessity of combining two digital approaches—on the one hand, the 
scientific reconstruction of acoustics and soundscapes, and on the other, 
contextualization of auditioning subjects within soundscapes. A problem 
of quietness persists in the “Organs of the Soul” project. It does not recreate 
as much as it attempts to describe the sonic reality of eighteenth-century 
Paris. Ideally, such projects would integrate the remarkable immersive and 
haptic achievements of historical aural augmented reality projects such as 
the Virtual Paul’s Cross Project with the historicization of sound found in 
“The Roaring Twenties.”** Such projects would require teams of specialists 
from across disciplines that could cooperate toward sonified replication 
and reenactment. Shawn Graham and his cohort note that the problem with 
aural augmented reality projects remains how to bring visitors to hear in a 
historically situated way.” Though ruptures between contemporary and his- 
torical understanding can elicit productive cognitive dissonances, “Organs 
of the Soul” demonstrates that the kind of information necessary to attempt 
historically situated listening lurks in past forms of recording technology 
including archival documents, musical notation, and surviving objects and 
architectural structures. The question becomes: How can scholars sonify 
this information and present it in a format that welcomes visitors into the 
reenactment of historical acoustemologies? 

The Projet Bretez, an interinstitutional team of scholars and engineers 
across France led by musicologist Mylène Pardoen, provides the replica that 
complements my quest for eighteenth-century Parisian audition presented 
in “Organs of the Soul.””? A historical aural augmented reality project in- 
spired by the experience of video games, Bretez reconstitutes, in great de- 
tail, a sound walk through the Chatelet area of 1730s Paris, and eventually 
the project will be installed for public view.** The team also hopes to develop 
the installation into an immersion room, make it accessible through virtual 
reality goggles, and create an application for tablets and smartphones. Proj- 
ect leader Pardoen identifies two goals of Projet Bretez: to recuperate the 
material dimension of sounds from the past and to create an augmented re- 
ality of quotidian sound.” At first, Bretez visitors hear only their own breath 
and footsteps, as they peruse a map of 1730s Paris, then, as they enter into 
the streets, their ears are filled with sounds of crowd commotion, tavern 
music, birds cawing, and water dripping, while they walk past exacting rep- 
licas of buildings that once stood on and around the bridges that cross the 
Seine. In the spirit of augmented reality, visitors are supposed to experience 
1730s Paris not through an avatar but as themselves. Sounds for the project 
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were recuperated from earwitness testimonies, maps, and drawings, among 
other historical sources, and replicated through the use of period objects 
and machines. Through careful acoustic modeling work, engineers are cur- 
rently developing reverberation and echoes true to the architectural spaces 
in which the visitor is immersed. 

Historical aural augmented reality projects aim to create productive 
dissonances between the past and the present by presenting familiar ex- 
periences that visitors can grasp while also pushing against their modern 
assumptions.” The common experience of bustling city street life serves as 
modern listeners’ entry point into this eighteenth-century simulation. As 
Pardoen explains, even today we are familiar with the density and collective 
experience of city life, and it is this common point of reference between 
past and present that should facilitate interaction with the project.” Despite 
the sound of crowds heard throughout the walk, Bretez does not visualize 
eighteenth-century people for both practical and intellectual reasons. The 
creation of numerous individuals to inhabit the project space would re- 
quire a significant logistical undertaking, and a crowded virtual landscape 
could slow communication between servers and devices when the project 
ultimately becomes a tablet and smartphone application. It would also be 
impossible to create the physical sensation of a crowd to corroborate the 
sonic and visual representation. To justify this decision, Pardoen notes that 
people tend to walk in a city with their eyes lowered, hearing their envi- 
ronment while not particularly regarding it.” Thus, an attempt to block out 
fellow city dwellers should function as one of the commonalities between 
eighteenth-century and modern urban walks. Most interesting, though, 
Pardoen explains that if people were included in the virtual landscape, 
careful consideration would have to be given to how the eighteenth-century 
French language sounded, and the team feels that too many questions linger 
on this issue to confidently include discernable speech.”° 

The Bretez team’s insistence on fidelity to past sounds and its distrust of 
auditioning subjects resonates with the parameters of the Virtual Paul’s Cross 
Project. While recuperating historical sounds, the Bretez team attempted to 
distinguish objective descriptions of sound provided by eighteenth-century 
earwitness accounts from the sentiments or interpretations expressed by 
those auditioning subjects about their sonic experiences. In addition to 
invisible people, scholars of eighteenth-century France will note a salient 
lack of bells in the Paris sound walk. On a practical level, because the 
project is currently meant as a prototype for museums, the team avoided 
the incorporation of sounds above a certain decibel level in consideration 
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of museum employees who would listen to the project on repeat. From an 
academic perspective, though, Pardoen felt that the inclusion of bells would 
require an explanation of the language of bells, an issue she believes would 
concern scholars more than museum visitors and the general public. In 
essence, bells might alienate modern listeners from the commonality 
achieved through the concept of a city walk. If the Bretez team introduced 
bells into their replication, they would be forced to confront auditioning 
subjects, who offer the key to understanding this historical sonic marker. 
A similar concern motivates the two pages in “Organs of the Soul” that 
address the language of bells and describe both the significance of bells in 
eighteenth-century French communities and the revolutionary context that 
resulted in the confiscation of these sonic markers.** Pioneering historical 
work by Alain Corbin has shown that bells delimited time and space in a 
way that was crucial to everyday French life before the revolution.” Ideally, 
a digital audible history project could present the language of bells not as 
textual marginalia, as it is presented in “Organs of the Soul,” but within the 
context of a soundscape replication like Projet Bretez. Though Bretez shares 
my interest in historical audition, its conviction to faithfully excavate past 
sounds necessitates that emotions attached to sounds be parsed out from 
the recovery of sensorial experience. 

When earwitness subjectivity—and perhaps even mishearing—is si- 
phoned off during the excavation of past sounds, digital audible history proj- 
ects miss an opportunity to create dialogue between historical auditioning 
subjects and modern listeners. To return to a previous example, the siren 
stories would be far less compelling without my own experience elucidating 
them. A desire to facilitate transhistorical communication motivated the 
podcasts found on the “music” path of “Organs of the Soul.” 33 The podcasts 
present eighteenth-century Parisian debates about the merits of French and 
Italian opera from various historical perspectives, including those of com- 
posers, men of letters, salon women, and the royal family. The podcasts were 
the result of a semester-long master’s seminar I taught titled Quarrelling 
about Opera in Eighteenth-Century France. The conception and production 
of the project were completely in the hands of music graduate students in 
my course who carefully studied academic sources on the topic. Narrators 
in the podcasts speak in the present tense, and so the podcasts are a type of 
historical reenactment presented through a twenty-first-century medium. 
Music illustrates well how modern listeners assume they understand a sonic 
experience merely because it exists in both the past and the present, even 
though modern ears could not possibly hear the political, social, and cul- 
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tural debates that underpin, for example, eighteenth-century descriptions 
of Italian music as spicy or French music as refined. Listeners in eighteenth- 
century Paris, like listeners in any time and place, experienced music within 
a unique context. As Bretez takes the familiar experience of collective city 
life as its point of entry, the podcasts employ a familiar medium to present 
historical arguments in an engaging, haptic form. Podcasts tune modern 
listeners to current news and debates, and in this case to contemporaneous 
issues in eighteenth-century Paris. Of course, the podcast reenactments 
required creative liberties—silly accents to help the listener distinguish 
between a complicated cast of characters, background noise to create space 
in the listener’s mind, and invented characters to develop a straightforward 
and entertaining narrative. These liberties, however, do not detract from 
the careful academic research and debate that produced these podcasts, 
evinced by the traditional “footnotes” that annotate the podcasts. A modern 
listener can acquire from the podcasts the sonic knowledge that informed 
how eighteenth-century auditioning subjects in Paris experienced opera. 
The podcasts might be critiqued as historical fiction, but even so, they offer 
a solution to pulling historical acoustemologies from the textual marginalia 
and into modern sensory experience. 

As I write this, I watch a little girl playing in a park sandbox. Her mother 
holds a tiny sifter, demonstrating how to strain the sand and to search for 
objects. On the most palpable level of experience, the child is merely playing. 
Developmentally, though, she is learning to use a tool, to search systemat- 
ically, and to evaluate objects. The metaphor here for my vision of digital 
audible history is both fortuitous and striking—both academics and the 
public should enjoy opportunities to “get dirty” and “hold the sifter” during 
the digital excavation of historical acoustemologies.* Each group will take 
away different knowledge from the process, of course, but these audiences 
need not be relegated to separate sandboxes. Admittedly, institutional silos 
cause some roadblocks to this kind of inclusive scholarship because massive 
projects like Bretez, for example, require significant funding. A flow chart 
depicting the transdisciplinary actors and tools that make up Projet Bretez 
includes scholars from four humanistic disciplines; web developers; infor- 
mation scientists; experts in urban studies, geography, and archaeology; 
and innumerable digital platforms and providers of technological support. 
To successfully obtain funding for such complex projects, grant writers 
must often make a case for the widest possible impact. In these public it- 
erations, academic considerations might be sidelined in the final product. 
This false dichotomy between the public and the academic also rests at the 
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heart of the authenticity and reenactment issues that I raised previously. 
The troubling underside of those debates assumes that the public cannot 
think and that academics cannot play. Digital audible history might breach 
this barrier and invite the public to engage more critically in the recovery 
of history and allow academics to immerse themselves in the reenactment 
of sources. Such a conceptual shift would require funding institutions to 
reconsider the rigid definition of audiences that is often required by grant 
applications. Subsequently, universities would need to reconsider the kinds 
of scholarship that support tenure and promotion cases. 

The strength of digital audible history rests in its ability both to fore- 
ground sounds recovered from the past and to simulate knowledge carried 
within, around, and among sounds from a particular time and place. In 
the twenty-first century we cannot comprehend the word “citizenship” 
with eighteenth-century minds, but we can work toward an understand- 
ing of eighteenth-century conceptions of “citizenship.” Just as scholars 
reconstruct concepts around words before interpreting them historically, 
concepts around sounds must be reconstructed before we can understand 
how they were heard. Digital audible history should not only recover and 
reconstruct sounds, but, more importantly, it should also reanimate histor- 
ical acoustemologies. Anxieties about inauthenticity and anachronism in 
digital audible history reveal how traditional academic formats like books 
and articles also mediate historical material, demanding that scholars con- 
front themselves as a medium, as well. The materiality of digital formats 
demands reflection upon how writing has also both facilitated and obscured 
our insight into the past, and how archival research is a contingent practice 
performed within an institutionalized set of discourses that can never ho- 
listically or authoritatively represent historical experience. The challenges 
of digital audible history reveal the extent to which methodological and 
theoretical assumptions rest in the very form of scholarship. Therefore, 
the digital reconfiguration of sonic artifacts, which sometimes performs 
and reenacts archival materials, should not be considered inauthentic or 
anachronistic. Rather, it should be understood as an effort to engage past 
auditioning subjects in the present to create a new archive for the future.” 
One might ask what digital audible history is for. Digital audible history 
both recovers past sounds and reanimates past acoustemologies. This goal 
requires not only replicas, which imply a distanced, museum-like regard, 
but also reenactment, which implicates and engages both the scholar and 
her audiences in confrontations with historical acoustemologies. 
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NOTES 


Feld, Jazz Cosmopolitanism, 49, and “Acoustemology.” 

Feld, Jazz Cosmopolitanism, 131. 

These methods have particularly flourished in the subfield of archaeology 
called archaeoacoustics. Researchers have worked toward establishing 
stricter methodologies; see, for example, Debertolis et al., “Research for an 
Archaeoacoustics Standard.” High-profile projects that have stemmed from 
the field include a reconstruction of the sound of Stonehenge (Till et al., 
Sounds of Stonehenge). Archaeoacoustic research has been used to develop 
aural augmented reality apps, which enhance modern experiences of histor- 
ical or ancient sites. For example, an iPhone app developed in consultation 
with Till’s team displays what Stonehenge would have looked like as visitors 
walk around the site, and, through headphones, plays reconstructions of the 
stones’ echoes in various locations. Shawn Graham et al. explore recent work 
in the field of archaeoacoustics in “Hearing the Past.” 

4 Ispecify the term “pre-recording-technology” to denote time periods for 
which we have no sound recordings such as vinyl records, films, tapes, com- 
pact discs, etc., within the archive. I chose this term as opposed to “preme- 
chanical reproduction,” which could encompass much earlier technologies 
such as the printing press, barrel-pin plates, and more. 

5 Ina panel on “Embodying the Past: The Rewards and Risks of Reenactment,” 
convened at the 2014 annual meeting of the American Society for Eighteenth- 
Century Studies (fittingly held in Williamsburg, Virginia—a Mecca of living 
history), panelists and audience members engaged in a fruitful dialogue about 
the anxieties and challenges faced by eighteenth-century scholars who support 
or participate in reenactment as a means of academic inquiry. The discussion 
became a type of group therapy in which scholars “came out” as believers or 
participators in living history—embodying the past in the present. 

Schneider’s Performing Remains astutely reveals the tangible historical work 
that reenactment, and specifically reenactments of Civil War battles, achieves. 
She asserts that reenactors “engage in this activity as a way of accessing what 
they feel the documentary evidence upon which they rely misses—that is, 
live experience” (10). This emphasis on live experience becomes paramount 
in time-based art, or historical evidence that is considered ephemeral (for 
example, sound or music). Schneider concludes that in its desire to preserve 
the ostensible purity of written archival traces, mimesis becomes debased 
as a means of accessing the past. Conversely, the performance of the past, of 
these archival traces, in the present negotiates a new archive for the future 
that is not solely dependent upon a monomaniacal belief in the written (silent) 
archive as authoritative. 
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For background on debates that surrounded historically informed perfor- 
mance practice during the 1980s and gos in the discipline of musicology, see 
Butt, Play with History, 3-52. 


7 Brady, Spiral Way. 
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Szendy, Listen. 

Schafer, Soundscape, 8—9; see also Rodaway, Sensuous Geographies. 

Corbin, Village Bells; M. Smith, Listening to Nineteenth-Century America; M. Smith, 
Hearing History; B. Smith, Acoustic World; Thompson, Soundscape of Modernity; 
Rath, How Early America Sounded; Birdsall, Nazi Soundscapes; and Ochoa Gautier, 
Aurality. 

The distinction between acoustic space and soundscapes is set forth in Mlekuz, 
“Listening to Landscapes.” 

Virtual Paul’s Cross Project. Articles by Wall resulting from the project include 
“Transforming the Object of our Study,” “Recovering Lost Acoustic Spaces,” 
and “Virtual Paul’s Cross.” 

Iuse the term “intellectually rigorous” because the Paul’s Cross team applied 
principles from the London Charter for the Computer-based Visualization of 
Cultural Heritage to acoustic realizations and modeling, although analogous 
standards for such acoustic projects do not yet exist. The London charter es- 
tablishes “internationally recognised principles for the use of computer-based 
visualisation by researchers, educators and cultural heritage organisations.” 
The full text can be found at www.londoncharter.org (accessed November 28, 
2017). 

Blesser, Spaces Speak, Are You Listening? 

Virtual Paul’s Cross Project. “Outcomes.” Accessed November 28, 2017. http:// 
vpcp.chass.ncsu.edu/outcomes. 

Virtual Paul’s Cross Project. “The Interactive Sermon.” Accessed November 28, 
2017. http://vpcp.chass.ncsu.edu/listen-interaction. 

Thompson, “The Roaring Twenties.” 

Thompson, Soundscape of Modernity. 

See, for example, Johnson, Listening in Paris; Nancy, Listening; and Szendy, Listen. 
Geoffroy-Schwinden, “Organs of the Soul.” 

See Graham et al., “Hearing the Past.” 

Graham et al., “Hearing the Past.” 

Bretez Site Officiel. 

A prototype of the project on YouTube can be found through Cailloce, “Ecoutez 
le Paris du XVIIIe siècle.” 

Mylène Pardoen (principal investigator), personal communication with the 
author, June 21, 2016. 

Graham et al., “Hearing the Past,” describe the concept as “breaks” that focus 
a participant’s attention. For example, when visitors experience the Bretez 
Project in Chatelet, they will likely be struck by the discordance between 
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the simulation and their modern experience of Châtelet, and in turn, this 
should cause visitors to focus more thoughtfully on histories of their current 
surroundings. 

27 Pardoen, personal communication with the author, June 21, 2016. 

28 Pardoen, personal communication with the author, June 21, 2016. 

29 Pardoen personal communication with the author, June 21, 2016; and Pardoen, 
email message to author, June 24, 2016. 

30 Pardoen, personal communication with the author, June 21, 2016, and Par- 
doen, email message to author. On the language of bells in eighteenth- and 
nineteenth-century France, see Corbin, Village Bells. 

31 Geoffroy-Schwinden, “Organs of the Soul: Sound,” 5, 6. 

32 Corbin, Village Bells; also see note 10 above. 

33 Geoffroy-Schwinden, “Organs of the Soul: Music,” 2. 

34 Inan interview with Gita Manaktala, Thompson articulated a similar goal for 
“The Roaring Twenties.” Manaktala, “Aural History on the Web.” 

35 Schneider, Performing Remains; also see note 5 above. 
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SOUND PRACTICES FOR 
DIGITAL HUMANITIES 


STEPH CERASO 


In much of our experience our different senses do not unite 
to tell a common and enlarged story. 


— JOHN DEWEY, Art as Experience 


The coaster steadily clicks and clacks until it gets to the peak of the hill, slow- 
ing until there are just a few punctuated beats—then comes the whooshing 
rush of the stomach-sinking drop. Riding a rollercoaster is an immersive, 
holistic sonic experience. Wooden rollercoasters elicit an especially unique 
affective response that cannot be replicated in smoother, faster, and much 
quieter steel speed coasters. The distinct thunderous roar produced by the 
wooden tracks is experienced not only through the ears but through the en- 
tire body. The feeling of the rattling, clattering sound is what propels and 
intensifies the journey for riders; their bodily experiences are inextricably 
linked to the jarring sounds of the coaster. 

While not every sonic encounter is as exhilarating as a rollercoaster ride, 
it is not unusual to experience sound as a sensorially invigorating event. 
Standing near the stage at a concert, playing an instrument, or simply driv- 
ing one’s car when a Mack truck zooms by are multisensory, as opposed 
to merely auditory, sonic experiences. Though listening is almost always 
associated with the ears, these examples make clear that the experience 


of sound is not limited to a single sense. Indeed, the convergence of sight, 
sound, and touch (and sometimes smell and taste) is in part what makes 
sonic interactions so engrossing and compelling. 

Yet when sound is incorporated into digital environments, the multisen- 
sory potential of sound tends to be dismissed or forgotten. Specifically, in 
most digital scholarship sound is treated as a semiotic resource rather than 
an experience. Sound files that are embedded into websites, blogs, digital 
archives, and other audio projects are used to enhance or exemplify the 
content of an accompanying textual narrative, to serve as narratives in and 
of themselves (e.g., podcasts, interviews), or to enrich visual media (e.g., 
digital maps, video soundtracks, and voiceovers). Other than the fact that 
sound can be heard—for those of us with working ears—there is not much 
difference between the typical ways that sound is incorporated into digital 
scholarship and more traditional alphabetic forms of scholarship. Like 
text, sound is presented as information that is ripe for interpretation and 
analysis. The dissemination of meaningful sonic information in digital 
scholarship takes precedence over users’ embodied experiences—the ways 
in which users physically interact with and are affected by sound at the level 
of the senses. 

There is certainly scholarship that calls for or works best in more tradi- 
tional audio formats. However, to approach sonic scholarship exclusively as 
another site of meaning making is to ignore both the distinct affordances of 
composing in digital contexts and the fact that living, sensing, nerve-filled 
human bodies—not just ears and brains—interact with it.’ As the editors 
note in the introduction to this collection, “Dealing with sound means 
dealing with the lived experience of people.” Alongside digital projects 
that resemble familiar textual scholarship, how might the lived experiences of 
listeners play a more salient role in the production of digital sound studies 
work? How might we account for and learn from the sonic experiences of all 
bodies—including deaf or hard-of-hearing individuals—and how might such 
bodily experiences inform digital design? 

This essay proposes several “sound practices” that are intended to help 
scholars account for fully embodied kinds of sensory engagement; these 
practices amplify the ecological relationship between sound, bodies, and 
environments. The term “sound practices” refers to more than the literal 
sounding of digital scholarship. The definition of sound as “exhibiting or 
based on thorough knowledge and experience” resonates with these prac- 
tices as well.* Drawing from and extending this definition, sound practices 
are intended to encourage scholars to produce work that is grounded in a 
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thorough knowledge of the ideas they are exploring and a thorough knowl- 
edge of the diverse ways that bodies experience sound. That is, sound prac- 
tices imply a thoughtful consideration of one’s own and others’ embodied 
listening experiences during the processes of creating, designing, publish- 
ing, and interacting with digital sound scholarship. 

As evidenced by the range of dynamic work in this collection, we are 
still in the early, noisy stages of figuring out what “counts” as digital sound 
studies; it is an area of digital humanities that is being invented as it grows. 
With the potential for invention and growth in mind, this essay adopts a 
generous, roomy conception of digital sound studies that includes the type 
of small-scale sonic experiments featured in the digital counterpart to this 
book. While the sound practices identified will ideally prove useful to digital 
scholars writ large, they are aimed at those interested in using sound to im- 
merse listeners in sensory-rich experiences. Such creative-critical projects 
can energize and broaden the scope of digital sound studies (and digital 
humanities) by emboldening scholars to take more imaginative, playful, 
and inclusive approaches to sonic scholarship. 

Sound practices ask scholars to rethink and work around the constraints 
of digital composition—from two-dimensional screen space to the limited 
audio capabilities of digital devices—to produce more holistic sonic expe- 
riences. What follows, then, is an exploration of the various possibilities 
for creating digital sonic interactions that go beyond exclusively ear-centric 
modes of listening; for producing digital sonic experiences that are more 
similar to the kinds of intense, affectively powerful experiences of sound in 
physical environments; and for designing heightened, flexible, and immer- 
sive sensory experiences in digital contexts. In the spirit of this collection, 
the sound practices outlined below serve as provocations for initiating more 
substantive conversations about the multisensory possibilities of digital 
sound studies scholarship. 


Sound Practice #1 


Consider how different bodies with a range of sensory capacities and diverse 
needs might interact with sound-based digital projects. 


Thinking about how audiences will intellectually respond to and make use 
of sound in digital scholarship is a standard practice. I would argue, how- 
ever, that there needs to be more emphasis placed on accounting for how 
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different kinds of bodies might interact with and have access to sound in 
digital spaces. Rather than assuming that all bodies are uniform—that all 
listeners listen in the exact same way—composers of sonic scholarship need 
to acknowledge and plan for an audience that consists of a diverse range of 
bodies with various sensory capacities and learning needs. 

As a starting point for creating more inclusive digital experiences, schol- 
ars working with sound could benefit greatly from having more explicit 
conversations with disability studies scholars (and vice versa).? In recent 
years sound studies scholars such as Mara Mills and Gerard Goggin have 
begun to explore disability in relation to media history and technological 
innovation.* While issues of disability and access have been spurring lively 
discussions in textual sound studies scholarship, they have been largely 
ignored in the actual production of sonic scholarship. As a result much dig- 
ital audio work is still being created for an “ideal” listener, thus excluding a 
broad swath of the population with disabilities and learning needs—most 
notably people who are deaf or hard-of-hearing—from interacting with and 
contributing to this work. 

Increasing access should mean more than making sonic material avail- 
able and presenting it in ways that will be useful for scholars from different 
disciplinary backgrounds. It is also critical to provide users with multiple 
modes and pathways to engage with and understand sonic scholarship; flex- 
ibility must become a key part of the design process. In other words, increas- 
ing accessibility will require scholars to practice universal design. As Jay 
Dolmage and Cynthia Lewiecki-Wilson write, universal design is a concept 
that “holds that one should design spaces and learning environments for 
the broadest possible access.”* Adopting universal design as a fundamental 
practice is a necessary and critical step toward the creation of more inclusive 
sound-based work in digital environments.° 

Universal design played a central role in the development of my own dig- 
ital sound experiment for Provoke! My project, “A Tale of Two Soundscapes,” 
examines the relationship between sound and embodied experience in 
two strikingly different sonic environments: a small town near the Smoky 
Mountains of North Carolina and the city of Pittsburgh, Pennsylvania. The 
approach to listening that I enact in “A Tale of Two Soundscapes” offers an 
alternative to strictly ear-centric modes of listening and amplifies sound as 
a multisensory experience. The creation of this audiovisual narrative, as well 
as the extensive research that emerged from it, heightened my awareness of 
the unique ways that different bodies engage with and make sense of sound 
in a range of environments. In the digital context I was designing for, one 
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of my goals was to provide multiple ways for users with various listening 
capacities and preferences to interact with and understand my project. 
Thus, users who may not be able to hear the audio can read the transcript, 
which makes available both the written language for my voiced script and 
descriptions of the nondiscursive sounds that occur in conjunction with my 
voice. In addition, I included a video of still images that helps to visually 
contextualize the two contrasting soundscapes that are being explored, and 
the script provides time markers for users who want to compare what is 
happening in the text with what is happening in the video. 

Significantly, users have the option to interact with these different media 
in whichever way(s) best suits their needs and purposes. By offering users 
various choices for accessing the same material, I tried to follow the lead of 
disability studies scholars like Stephanie Kerschbaum, who writes, “Those 
who design and produce multimodal texts and environments need to incor- 
porate redundancy across multiple channels in order to make digital texts 
more—not less—flexible, and they should enable customization and ma- 
nipulation of these texts.”’ While developing “A Tale of Two Soundscapes,” 
I became acutely aware of the ways that redundant design can effectively 
facilitate multiple pathways for interaction. As a result, this piece was de- 
signed to give users the option to listen to the audio only, or to listen to the 
audio while following along with the transcript, or to read the transcript 
on its own or while interacting with the video, or to listen to the audio and 
watch the video simultaneously. I also included longer clips of the isolated 
soundscape tracks for listeners who want a chance to focus on individual 
field recordings without the distraction of a voiceover. These longer clips 
provide a point of comparison for the ways in which the field recordings 
were manipulated and edited in the main audio narrative, calling attention 
to the mediation inherent in the creation of sound-based digital work. As I 
found out, redundant design serves a dual purpose: it gives users multiple 
ways to engage, and in doing so it makes other forms of intellectual work 
possible. In this case, it makes the process of composing transparent (and 
therefore available for examination) by revealing how I did and did not alter 
original field recordings. Accessible design, then, need not be approached 
in a strictly practical way; it has both utilitarian and intellectual functions. 

Though I tried to make my project accessible to a broad audience, I do 
not mean to suggest that it is ideal for every user in every situation. That 
would be impossible. As the authors of “Multimodality in Motion” remind 
us, “Universal design is a process, a means rather than an end. There’s no 
such thing as a universally designed text. There’s no such thing as a text 
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that meets everyone’s needs. . . . But to say that no text will be universally 
accessible is not a justification for failing to consider what audiences are 
invited into and imagined as part of a text.”* Universal design is something 
that everyone can strive for and work toward. Choosing to think seriously 
about who might be listening to and interacting with our work will open up 
new possibilities for who is “invited into and imagined as being a part of” 
the digital sound studies community.’ 

At the same time, it is important to recognize that designing projects for 
an abstract broadest possible audience is not enough. It is also essential to 
consider how individual users actually interact with published work. One 
of the advantages of publishing digital scholarship is that it does not have 
to remain static and fixed like most print publications. The fact that digital 
work can be changed and revised gives authors a chance to get feedback 
from individual users and continue to tweak their work based on reported 
suggestions or accessibility issues.* Scholars can encourage such feedback 
by providing statements of access on their main project pages, including 
contact information, so that users with questions or concerns can reach 
them directly.™ 

As Dolmage convincingly argues, accounting for both universal design 
and usability, or how people are able to interact with digital scholarship (or 
not), can result in productive conversations that get projects closer to achiev- 
ing the broadest possible access.*? Rather than only making “corrections” 
to digital audio work because of accessibility complaints—what is referred 
to as “retrofitting” in the disability studies community—relying on both 
universal design and usability is a way for authors to produce scholarship 
that is widely accessible from the start, and to collaborate with users via 
discussing and discovering new ways of inclusion.*? 

Increasing access to sound scholarship is necessary first and foremost 
because all listeners—regardless of sensory capacities and bodily needs— 
deserve the opportunity to participate in and contribute to this exciting and 
steadily growing area of digital humanities. Further, the participation and 
contributions that result from increased access could expand and augment 
digital sound studies in important ways. I could envision, for instance, dig- 
ital audio projects by deaf scholars that enact their individual sonic experi- 
ences, thus contributing to understandings of listening as a body-specific, 
multisensory practice; or perhaps digital work that focuses on how various 
kinds of embodied experiences influence the ways in which individuals 
respond to and make sense of sound in different contexts. Indeed, though 
I have chosen to focus on disability in this discussion, it is equally import- 
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ant to represent and perform embodied experiences of race, gender, class, 
age, ethnicity, and sexual orientation in digital scholarship. Such bodily 
experiences have a profound effect on how people engage with the sonic 
world. Ifa more diverse range of bodies and bodily practices was welcomed 
into and encouraged to take part in the conversation, imagine what insights 
and boundary-pushing projects might emerge. Cultivating a more inclu- 
sive digital sound studies community by devoting substantial attention to 
embodied experiences will lead to a richer, more capacious intellectual and 
creative space for digital scholarship. 


Sound Practice #2 


Take fuller advantage of the spatial and aesthetic features of digital sound 
projects to create more immersive user experiences. 


In contrast to the immersive experience of sound in three-dimensional 
spaces, it is easy to forget that sound in digital spaces is located in an envi- 
ronment at all. If they can see, listeners engage with sound while looking 
at flat, two-dimensional images on a screen. If they can hear, they listen 
through minuscule speakers or tiny earbuds that diminish the effects of 
sound. Though sonic composition for digital environments has its limita- 
tions, it seems to me that scholars can enliven the experience of their sonic 
work by taking fuller advantage of spatial and aesthetic affordances in dig- 
ital spaces. That is, in addition to treating sound as an object that is the 
analytical focal point of digital sound studies scholarship, we might also 
use sound as a way to create more dynamic digital environments—digital 
spaces that bodies navigate and experience via multiple senses. 

One way to create more immersive sonic experiences for users is to learn 
to think more like acoustic designers. Acoustic designers (sometimes called 
acoustic engineers) are sound professionals who design, change, and/or en- 
hance the acoustical environment of particular spaces—from restaurants to 
concert halls to parks. Though acoustic design is a complex interdisciplin- 
ary field, here I want to amplify a basic acoustic design principle that I find 
relevant for digital sound studies: acoustic designers treat sound as an element 
that is connected to and influenced by a larger aesthetic and spatial network.” 

Consider, for example, the acoustic design of the lobby of an office build- 
ing. The lobbies of buildings are places where socializing is expected, and 
thus they are designed to be sonically lively places. To add some extra noise 
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and life into the space, acoustic designers would design or manipulate the 
spatial and aesthetic features of lobbies—via ample open space, high curved 
ceilings, hard surfaces like marble or concrete—to produce a reverberant 
environment, or a space where sound persists after the original sound is 
produced. Reverberation makes it seem as if there is more sound filling a 
space than actually exists, giving the space a warm, energetic atmosphere 
that makes people feel like it is appropriate to talk loudly and be more 
social. However, since the rest of the building is dedicated to traditional 
office space where acoustics need to enable productive (i.e., less disruptive) 
working conditions, acoustic designers would design a quieter, deader 
acoustical environment to cue people to be less animated and social as they 
move through the building. In other words, the acoustics of the space would 
need to be designed to signal people to adjust their behavior accordingly: the 
rooms would be smaller and box-like to prevent reverberation, the hallways 
and office walls would be built with more insulation or sound-absorbing 
materials, and so on. Good acoustic designers are always conscious that 
the ways people experience and respond to sound in an environment are 
inextricably connected to the aesthetic and spatial features of the design.” 

While digital spaces are significantly different from three-dimensional 
spaces like the lobby of a building, being more cognizant of sound as a de- 
sign element that is connected to and shaped by other features of an environ- 
ment can help scholars produce more cohesive, immersive projects. Taking 
advantage of the spatial and aesthetic affordances of digital audio involves 
considering questions such as: How do I want listeners to move through and 
experience my project? How might I make the various digital spaces of my 
project more sonically distinct from one another? How does the experience 
I created enact the themes or arguments or stories I want to present? How 
do the aesthetic features (colors, textures, layout) influence the ways that 
listeners might experience sound? How can I enable nonhearing individuals 
to experience a sonic project, and in turn, how might addressing issues of 
access lead to a better design in general? In sum, approaching digital work 
like an acoustic designer requires thinking about sonic scholarship as a 
holistic experience for users. 

Sharon Daniel’s digital project “Public Secrets” serves as an excellent 
model of creative-critical sound scholarship that is designed with the ho- 
listic experiences of users in mind. In “Public Secrets,” Daniel takes users 
along with her into the sprawling prison-industrial complex in central Cali- 
fornia to hear the testimonies of women prisoners. There are many interest- 
ing features of the design, which masterfully integrates sound, text, visual 
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elements, and movement. What I find most striking, though, is the way that 
Daniel uses sound to draw (hearing) listeners into the experience.** In the 
opening sequence she verbally describes the scene of the prison. Her vocal 
track is layered with heavy music—a sorrowful, repetitive melody punctured 
by snare drums—as well as the ambient soundscape of the prison itself. The 
layered sounds immediately position listeners within the environment of 
the prison while evoking the tone or feeling of the space. 

Once users officially enter the project, they can choose different theme- 
based pathways to navigate through it. Clicking on these themes triggers 
more startling sounds: the creaking, locking, and slamming sounds of a 
heavy iron door. These sounds work to incorporate users into the prison 
experience. By making users “occupy” the same sonic space as the prisoners, 
Daniel is blurring the line between inside and outside. Other design ele- 
ments echo and intensify this blurring. The primarily black-and-white color 
scheme reflects the drastic differences between inside and outside (and is 
perhaps meant to conjure up other binaries: good and bad, right and wrong, 
etc.). However, the algorithmic structure of the project causes the black- 
and-white spaces of the screen to constantly shift depending on where users 
click, thus enacting the idea that things are not as clear-cut—as black and 
white—as they may appear. Sound, color, layout, movement, space. These 
integrated features of the design all serve to drive home Daniel’s main point: 
that the prison-industrial complex affects all of us, not just the lives of those 
women on the inside, whose hidden, incarcerated bodies are afflicted with 
racism, sexism, poverty, abuse, and addiction. We are all implicated in this 
networked system despite the boundaries we try to create between “us” and 
“them.” 

Much more could be said about the content and political implications 
of Daniel’s project. For the purposes of this discussion, though, I want to 
underscore that the use of nonverbal sound in “Public Secrets” is so effec- 
tive because it is thoroughly integrated with various aesthetic and spatial 
features of the design. The sound is not employed as an isolated part of the 
project but as a salient component of its sensory and thematic experience as 
awhole. Daniel’s consideration of how bodies move through and participate 
in a space via multiple senses and modes is the key to creating an affectively 
powerful and thought-provoking experience for users—an experience that 
could not be accomplished through a more linear (or traditionally academic) 
version of her work. 

By calling attention to “Public Secrets” as an example of what an acoustic 
design approach might look like in a digital environment, I do not mean 
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to suggest that every digital sound project needs to be or even can be an 
immersive experience. Clearly, the design one chooses would depend on 
the purposes and goals of the scholarship. It is also important to recognize 
that “Public Secrets” is a large-scale undertaking that was made possible 
through generous institutional funding and the support of Vectors, an inno- 
vative digital publishing platform. Though not every scholar will have access 
to such resources, I think that there is still a lot of room in both large- and 
small-scale digital sound studies work for experimenting; for designing 
more holistic experiences for users (as opposed to presenting sonic data or 
information)—for treating sound as an element that is connected to and 
influenced by the other features of a design. Work like Daniel’s has only be- 
gun to tap into the possibilities for producing distinctive, compelling digital 
sound environments. My hope is that her example will inspire more scholars 
to discover and create sensory-rich sonic experiences in their own projects, 
regardless of scope and scale. 


Sound Practice #3 


Explore and experiment with the physical effects of sound in digital contexts. 


Digital work regularly takes advantage of the audible and visual possibili- 
ties of sound. The simple act of being able to incorporate audible files into 
digital environments is what caused the initial wave of enthusiasm for sonic 
forms of scholarship. In recent years, this scholarship has been evolving 
and extending in more synesthetic ways. For example, there have been an 
increasing number of sonification projects, such as Listen to Wikipedia and 
BitListen, that give sound to previously nonsonic information. Additionally, 
sound and music visualization projects—encouraged by free applications 
like Sonic Visualiser—are becoming more common in scholarship across 
the disciplines. However, the physical effects of sound, or the experience of 
sound as a form of touch, remains a largely uncharted area. This is not es- 
pecially surprising since the experience of sound is etiolated in digital con- 
texts. Listeners cannot feel the sounds they listen to on computers or phones 
like they can when they are standing in front of massive speakers at a club. 
Most digital audio formats and the technologies used to engage with them 
are not able to re-create these kinds of felt sonic experiences. 

And yet, because the physical experience of sound is a significant part 
of how humans engage with and understand sound, it seems to me like 
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an area that is worthy of sustained inquiry and experimentation. While 
scholars such as Steve Goodman, Shelley Trower, and Michele Friedner and 
Stefan Helmreich have written thoughtfully about the physical, vibratory 
experience of sound in various contexts, I wonder how the physical effects 
of sound might be performed in digital environments.” How might digital 
sound studies scholarship explore and possibly re-create the tactile expe- 
rience of sound? What would scholarship look, sound, and feel like if more 
attention was paid to sound as a physical event? 

Current trends in audio technologies that celebrate vibration as a novel 
feature of listening experiences may be a productive starting point for 
investigating the role of touch in digital sonic work. Skullcandy Crusher 
headphones (advertised as “#bassyoucanfeel”) enable listeners to feel the 
low frequency sounds of bass via vibration. As stated on the Skullcandy web- 
site, “Our designers wanted to fix the problem ofa single sensory experience 
with conventional headphones. Combining audio with tactile senses creates 
a more realistic and immersive environment.””° Wearable technologies like 
the 3rd Space gaming vest also use tactile feedback to heighten the experi- 
ence of sound in video games.” Incorporating technologies like these into 
the design of future digital sound work—or at least presenting them as 
an option (“This scholarship works best with technology X”)—could help 
introduce tactile possibilities that allow for more fully embodied modes of 
engagement. 

Assistive technologies offer further opportunities for experiencing sound 
as a form of touch. Psychology professor Frank Russo and his research team 
recently invented a chair that is intended to enhance musical experiences 
for deaf and hard-of-hearing audiences. The “emoti-chair,” Russo explains, 
is able to “separate out the frequencies and present them to different parts 
of the body. We’ll take the high frequencies and we’ll present them to the 
upper part of the back. We’ll take the lower frequencies in the music signal 
and we’ll present them to the lower part of your back.” Rather than simply 
re-creating a general feeling of vibration, the chair offers a more precise 
experience of music by pinpointing where certain frequencies resonate in 
the body. The emoti-chair is a great example of how assistive technologies 
that were designed for people with disabilities could enrich human experi- 
ence more broadly. As Graham Pullin points out, specialized products that 
are created because of “issues around disability [can] catalyze new design 
thinking and influence a broader design culture in return.”*? Digital sound 
projects that examine and play with the bodily locations of felt frequencies 
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via technologies like the emoti-chair might facilitate entirely new ways of in- 
teracting with digital sound scholarship for everyone—not just people with 
disabilities.” Indeed, as I have stressed throughout this essay, addressing 
issues of accessibility often results in designs that are broadly beneficial to 
users as opposed to directed only toward a specific group of users. 

Designing projects that involve supplemental technologies will of course 
raise issues of cost and access. To make tactile experiences a more promi- 
nent feature of digital audio work, scholars will need to continue to discuss 
and troubleshoot the technical and conceptual challenges of creating schol- 
arship with and for these kinds of vibratory audio technologies. However, 
such projects do not necessarily have to be costly, large-scale endeavors. I 
could imagine work that takes advantage of the vibratory features of ordi- 
nary consumer products like smartphones. A phone application, perhaps, 
that provides vibratory feedback in relation to an environment’s noise level 
might be an interesting digital tool for making individuals more aware of 
their embodied experience of sound in different spaces. If an environment 
has particularly low decibel levels, the phone would automatically buzz 
intermittently; in environments with high decibel levels, the phone would 
vibrate more frequently. Tactile feedback would call users’ attention to their 
own physical experiences of sound in a space (something that people often 
shut out or ignore), thus alerting them to record and geo-tag the decibel 
information through the app. This hypothetical vibration-based app would 
enable users to construct a digital map of place-based bodily experiences of 
sound in their communities, thus helping others to find or avoid the sonic 
spaces that best suit their needs or preferences. 

Ofcourse, the fact that existing technologies present scholars with tactile 
possibilities does not mean that these technologies should be universally 
adopted. (“I want to make users feel this sound because I can.”) Scholars 
need to think seriously about how tactile information or force-feedback 
mechanisms would enhance their work—about what the ability to feel 
sound in digital scholarship would allow listeners to do or understand that 
would not be possible (or as effective) using only text, sound, and/or visual 
elements. That is, digital scholars should consider the distinct affordances 
of making sound available as a tactile experience for users. While the kinds 
of technologies mentioned above have limitations and may not be useful for 
every project, at the very least they have the potential to open up a productive 
area of inquiry for exploring touch/tactility in digital sound studies. 
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Enlivening Digital Sound Studies 


The sound practices I have outlined in this chapter are intended to invigorate 
digital sound studies scholarship by accounting for the lived, multisensory 
experiences ofa broad audience. Adopting and expanding on these practices 
can result in more engaging, flexible, and affectively powerful sonic com- 
positions and digital tools. To make an impact, however, sound practices 
cannot merely be taken up by individual scholars. Just as importantly, edi- 
tors of digital journals who publish sonic scholarship and the institutions 
that fund such work must be willing to accept and accommodate experi- 
mental, sensory-rich, and widely accessible digital sound studies projects. 
In other words, implementing sound practices is going to require collabo- 
ration. No single individual has access to all of the technical skills, knowl- 
edge, resources, technologies, and/or bodily experiences that are needed for 
the kinds of sonic work I have proposed. Thus, as in most digital humanities 
endeavors, it will be necessary to collaborate to find the right combination 
of people to turn ideas into reality. As I see it, the challenge of infusing dig- 
ital sound studies with more experience-based, body-conscious scholar- 
ship will be to organize networks of diverse bodies with a range of different 
needs, capacities, cultural identities, skill sets, disciplinary backgrounds, 
and professional positions. Such networks will bring us closer to a more 
inclusive, creatively thriving digital sound studies community—a commu- 
nity that I hope will make enough noise to be seen, heard, and felt in digital 
humanities. 


NOTES 


1 Scholarship that explores the senses as integrated rather than separating 
and/or privileging individual senses has been gaining momentum in recent 
years, particularly in anthropology and digital media theory. For an excellent 
overview of this work, see Porcello et al., “Reorganization of the Sensory 
World.” 

2 Merriam-Webster Online, s.v. “Sound (adj.),” definition 3b, accessed November 29, 
2017, www.merriam-webster.com/dictionary/sound. 

3 The call to pay more attention to issues of disability and access has been 
sounded in the larger digital humanities community as well. George H. Wil- 
liams writes, “It is imperative that digital humanities work takes into account 
the important insights of disability studies in the humanities, an interdis- 
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10 


11 


12 
13 
14 


15 


16 


ciplinary field that considers disability ‘not so much a property of bodies as 

a product of cultural rules about what bodies should be or do.’” “Disability, 
Universal Design,” 202. 

Mills, “DeafJam,” and “Hearing Aids”; Goggin, “Cellular Disability.” 
Dolmage and Lewiecki-Wilson, “Refiguring Rhetorica,” 26. 

For additional information about the origins of universal design and why it is 
vital for digital humanities more broadly, see Williams, “Disability, Universal 
Design.” 

Kerschbaum, “Modality.” 

Yergeau et al., “Multimodality in Motion.” 

The Web Accessibility Initiative of the World Wide Web Consortium website 
contains guidelines and instructions, as well as links to resources about 
accessibility and design. 

Ofcourse, the ability to change and revise digital projects also depends on who 
is hosting the project, what kind of relationship the host has to the author, and 
what types of labor people are willing to put into the continuation ofa project. 
Asking the editor or host of one’s project about issues of accessibility and 
possible changes is a good practice, particularly in the early stages of design. 
I have provided a basic statement of access on the main page of “A Tale of Two 
Soundscapes” and would welcome feedback. For a brief and helpful explana- 
tion of how to write accessibility statements, see Watson, “How to Write an 
Accessibility Statement.” 

Dolmage, “Evolving Pedagogy,” and “Disability, Usability.” 

For more on retrofitting, see Yergeau et al., “Multimodality in Motion.” 

My emphasis on more diversity in digital sound studies scholarship echoes 
similar calls by a number of digital humanities scholars and organizations. 
For instance, the position statement created at THATCamp SoCal reads: “We 
recognize that a wide diversity of people is necessary to make digital human- 
ities function. As such, digital humanities must take active strides to include 
all the areas of study that comprise the humanities and must strive to include 
participants of diverse age, generation, skill, race, ethnicity, sexuality, ability, 
nationality, culture, discipline, areas of interest. Without open participation 
and broad outreach, the digital humanities movement limits its capacity for 
critical engagement” (PhDeviate et al., “Towards an Open Digital Human- 
ities”). I see accessible design and an attention to usability at the level of the 
body as key to achieving more open participation. 

Thompson’s Soundscape of Modernity and Blesser and Salter’s Spaces Speak pro- 
vide a wealth of information on acoustic design, sound and architecture, and 
acoustical technologies. 

This example is based on information from interviews I conducted with pro- 
fessional acoustic designers while doing research for my current book project. 
For more information on my forthcoming book, visit www.stephceraso.com 
(accessed November 29, 2017). 
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17 Sterne’s “Sounds like the Mall of America” presents a fascinating, in-depth 
example of how acoustic environments are designed strategically to persuade 
people to behave in particular ways. 

18 In terms of accessibility, “Public Secrets” provides written transcripts of the 
prisoners’ testimonies. However, one of the limitations of this project is that 
it does not include captions for nondiscursive sound. Adding textual informa- 
tion for ambient sounds as they occur would further expand access to deaf and 
hard-of-hearing audiences. 

19 Goodman, Sonic Warfare; Friedner and Helmreich, “When Deaf Studies”; 
Trower, Senses of Vibration. 

20 Skullcandy Crusher: Inspiration behind Bass You Can Feel, March 29, 2013. 
www.skullcandy.com/blog/2013/03/29/crusher-inspiration-behind-bass-you- 
can-feel. 

21 TN Games, 3rd Space Vest (accessed April 13, 2014, http://tngames.com/ 
products). 

22 Mahoney, “Sound (and Sight and Feel).” 

23 Pullin, Design Meets Disability, xiii. 

24 The emoti-chair, for example, has the potential to improve products like the 
BoomChair, which features “interactive vibration motors” that heighten the 
experience of sound in video games, music, and movies. The experience of 
vibration in the BoomChair does not yet provide a location-specific and precise 
vibratory experience and could thus benefit from the design and technology 
used in emoti-chairs. BoomChair Official Site (accessed April 12, 2014, 
www.boomchair.com). 
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AFTERWORD 


DEMANDS OF DURATION 


The Futures of Digital Sound Scholarship 


JONATHAN STERNE, WITH MARY CATON LINGOLD, 
DARREN MUELLER, AND WHITNEY TRETTIEN 


DARREN MUELLER We first started our conversation with you at the early 
onset of our project. At that time, I remember that our conversation went 
back and forth quite a bit about the possibilities of technological innovation 
and what consequences it might have for sound studies. What do you think 
has changed in the field since then [2012]? Where are digital humanities and 
sound studies overlapping? 


JONATHAN STERNE That’s a really long time in the computer industry and 
it’s a really short time in the academy. I don’t know that there has been any 
giant leap forward. It’s more like conversations that have been going on for 
many years have continued. Movements like digital humanities have had 
a few more years to gain a foothold in the academy. It has become more 
normal to want to put audiovisual material inside humanities work across 
all fields, and so people are more comfortable with the idea of using digital 
technologies in their research and scholarship more generally. The equip- 
ment has gotten older, been replaced, been upgraded, and been broken. It’s 
an endless cycle. 


One of the things that’s really struck me, as I looked at the Provoke! website 
and read the book, is that a lot of the best digital humanities work in sound 
studies is pretty low-tech. When people want to found a digital humanities 
lab, they try to geta million-dollar grant or a few hundred thousand dollars, 
they buy a bunch of computers, get all of these servers, video stuff, high-res 
scanner, etc. But you don’t need to. Ifyou want to start doing digital human- 
ities in an undergrad sound class, almost all of your students, even if they’re 
fairly disadvantaged, have a recording device in their pockets. The software 
to edit those recordings on a computer can be found for free, software like 
Audacity, and there are lots of places on the web where you can upload this 
work, annotate it, and share it. Sounding Out! is a great example of this kind 
of work—they just use the WordPress platform, SoundCloud, and YouTube. 
It’s not that those things are perfect by any means, but in terms of barriers 
to entry, they are very, very low. The main issue is that labor that would be 
compensated in publishing is volunteered in editing the site. They explain 
their practice as a “labor of pleasure” in their piece, but it does raise a big- 
ger issue around the increasing concentration of tasks in the person of the 
scholar (which makes us a lot like artists and musicians, who are suddenly 
also simultaneously publishers, producers, promoters, etc.). 

If you want to start doing big data analyses of an author’s corpus, and 
that author’s work hasn’t already been digitized and you don’t have access 
to a digital humanities lab, then that is a much more expensive proposition. 
For instance, the work that Tanya Clement is doing with HiPSTAS—that’s a 
much more labor/capital/tech-intensive process that requires more advanced 
equipment (hardware and software), and technicians to work with it. And 
yet, as she talks about in her chapter, they are still having to figure out the 
basic, low-tech stuff, like how do you mark up audio in a way that is useful 
for scholars, and how do you actually analyze sound or get a computer to do 
it for you so that you can work at a higher meta level of interpretation? So 
there are a lot of dimensions to digital sound studies that are low-tech. If we 
want to follow my music research colleagues and start wiring up musicians 
to generate huge datasets based on their movements, that’s going to bea lot 
more expensive, but those activities also don’t mean much in a humanities 
context without rich humanistic questions to drive the inquiry. 


WHITNEY TRETTIEN I would completely agree that a lot of the best work 
is low-tech. As we began putting together our website, we found ourselves 
pushing against the idea of using an all-encompassing content management 
system or developing a big new tool, and instead we kept coming back to 
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HTML, simple web technologies, and very basic, small-scale projects as a 
model for digital sound studies work. But then, what has changed? So often 
we pinpoint technology as the thing that’s changing all of this—but here it 
seems like we’re all agreeing that technology is not the primary engine of 
change in the academy. What is? 


JS Well, I certainly don’t think it’s technologically driven at all. I think 
it’s institutionally driven. One of the reasons that digital humanities has 
burgeoned is that there’s money behind it. It’s one of the only places in the 
United States that you can actually apply for and get a large grant to do hu- 
manistic work. In the U.S. there have been some interesting crossovers with 
library and information science and curatorial practice and preservation 
and things like that, so there are these huge institutional incentives to get 
into digital humanities. 

There’s also the logic of academic fashion. Digital humanities is a new 
thing—I mean, there are arguments about when it was coined and whatever, 
but the term isn’t really in circulation before the twenty-first century—so it 
gets to be the new hotness. Every generation of scholars has to figure out 
how to get out of the intellectual mess made by the last generation. Through 
the eighties and nineties, it was the hermeneutic turn, the spatial turn, the 
theory moment. And now, instead of everything being about this herme- 
neutic turn, there seems to be this knee-jerk materialism that has replaced 
it. You can see it in the turn toward practice, of which digital humanities is 
a part. In Canada, there is a different-but-related practice called “research 
creation,” or in parts of Europe it’s called “artist research.” It’s tied to pro- 
ducing some kind of aesthetic work as the output of scholarship instead of 
a written piece. Often it comes out of an art school tradition, though, and 
some of it comes out of the need for artists to earn PhDs where the MFA used 
to be the terminal degree. But, as with digital humanities, it also represents 
a turn toward practice, and avery different response to the critiques of schol- 
arly writing that came from our teachers and their teachers. 

Any time you have this kind of ferment, it’s an opportunity to ask real 
questions about how we do our work and what might be most useful. When 
you think about something like the journal article, that is a textual genre 
that changes about every quarter-century. The codex is much more durable, 
but the journal article is not a long-term thing that can’t be messed with. 
So the digital humanities moment offers new opportunities to think about 
other kinds of periodical presentation of our work, especially when it comes 
to audio. It’s child’s play to put audio inside a PDF or inside a Kindle book or 
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something like that; the only reason that it’s not done is fear about copyright 
litigation. Our own unwillingness to fight for our fair-use rights, and bad 
old habits, are the only things that keep scholarship so silent. 

It also remains hard to mark up audio. You can sort of do it with the 
Scalar video player, but it’s inelegant. You can do it on SoundCloud, but of 
course SoundCloud isn’t designed for scholars marking stuff up, and so it 
has these other dimensions and issues to it. Its social model isn’t very good 
for scholars. It also has yet to turn a profit, which means the platform could 
change or disappear any day. There’s Joanna [Annie] Swafford’s Augmented 
Notes project, which is super cool, but it assumes that you’re working with 
a musical score, and it’s only really useful if written music enhances your 
argument. I’m struggling with this myself right now. I’ve got a piece on 
Auto-Tune that I’m almost finished with, and Pd like to publish it digitally. 
There are a few places that I want to annotate short audio clips and say, 
“Here’s what we’re talking about when we’re talking about really audible 
pitch correction”; and “This is why this is Auto-Tune and not a vocoder in 
this track”; and stuff like that. I mean, I can do it in SoundCloud, I can do it 
in Scalar, but neither provides the kind of reading experience I want to offer 
my readers. So, on the one hand we do need better tools, on the other, we’re 
pretty close in a lot of domains to being able to do a lot of stuff already. And 
most of the resistance as well as the impetus is institutional rather than 
having the tools.* 


MARY CATON LINGOLD This might be a good moment to follow up on 
some of those institutional problems that you talked about. We initially 
tried to find an academic press to publish the web collection and found that 
presses were concerned about being able to manage the project within their 
ecosystems. They wanted us to use an existing platform, for example, but 
we argued that HTML would actually be much simpler and longer-lasting as 
a technology than most content management systems. In the end, we self- 
published the project, but now we’re facing similar challenges preparing to 
archive the project so that it can be preserved at Duke Libraries. So it’s been 
really interesting to see how libraries and publishers are thinking about the 
production of digital scholarship. In terms of archiving, websites are not 
pieces of paper that you can stick in a box, and there are legitimate institu- 
tional concerns about scalability. As a scholar invested in advocating for the 
value of multimedia scholarship, what do you have to say to the academic 
publishing world out there and to tenure and promotion committees about 
fixing this problem before this moment is gone? That’s my fear: that there’s 
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money behind digital humanities now, but once this isn’t the hot thing, are 
we going to lose some of that opportunity for innovation? 


JS No, I don’t think so, because there are other pressures. Right now, math- 
ematicians, scientists, and some branches of academic medicine are in open 
rebellion against the for-profit science publishers, so it’s not all on the hu- 
manities. It’s part of a bigger movement.” There are a lot of things to note 
in your question: there’s the whole publication and prestige part, the plat- 
forms, and preservation, which are all different things that all begin with 
P [laughter]. 

The platform problem is a real one. Just think about print publication and 
all the different formats that libraries have had to figure out. What do you do 
with the book that is too big to fit on the shelf? Well, it has to go somewhere 
else. What do you do with an unbound periodical? Well, it’s got to go in a 
box. These are all things that librarians had to figure out how to catalog and 
manage. So in one sense we need to ask, “What kinds of digital containers 
can we legitimately be expected to maintain, and what range of things can 
exist inside of those?” A bunch of HTML pages that reference one another is 
probably pretty easy to keep going, but when you get into multimedia stuff 
or anything that’s more heavily coded, it can start to be a problem. 

With traditional publishing a lot of this stuff wasn’t on the shoulders of 
the people doing the scholarship. The press had the people who did layout, 
binding, and shipping. But with your website, you’re doing the binding, 
the layout, and the shipping (though probably someone else is handling 
the warehouse). That’s a fundamentally different proposition. On the one 
hand it’s another case of work that used to be done by others devolving into 
something that falls on the shoulders of academics who are asked to do it—I 
wouldn’t say for free—but on top of their other jobs. 

The preservation of multimedia materials is utterly puzzling. If you 
want to preserve video games, you’ve got to preserve the whole ecosystem 
of which they are a part. It’s the same thing with any kind of multimodal 
scholarship that depends on a certain kind of platform or artwork. One way 
to think about it is that not everything has to last. Some interventions are 
of the moment. But so much scholarship doesn’t work on that temporality. 
Timely interventions from a generation ago become influential arguments 
for reasons that the authors could not have foreseen. So I’m not real happy 
with the “let it all fade away” solution. 

Relatedly, one of the really important questions is whether the author can 
abandon the project. Because if you look at the life cycles of intellectuals, 
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there are many different kinds, but in almost every case, the way people ad- 
vance in their intellectual development is to finish projects and leave them, 
rather than to have to come back and continuously maintain them. That is 
why you have librarians and archivists whose job it is to maintain things. So 
we need a system that allows that kind of intellectual abandonment. 

My hunch as someone who studies standards and formats is that we’re 
going to wind up with standardization and official formats. And that’s why 
the publishers wanted to push you into using their platform. But of course 
their platforms change all the time! So it’s not a very reassuring proposition 
at the moment. Every year I go back to my website and I update it, and there 
are links to the books that I’ve edited, coedited, and authored, and almost 
every year the web pages that I’ve linked to are no longer there and they’ve 
moved somewhere else. Lisa Gitelman says the 404 error is the most com- 
mon page on the internet. 


wT I want to ask as a related side note, do you see a viable role for self- 
publishing in the academy in the future? 


Js Insome ways, all academic publishing is self-publishing in the sense that 
you have a group of academics that get together as a group and decide to put 
something out—especially the journals that are curated and edited rather 
than going through the blind refereed thing. Lots of important humanities 
journals are edited by collectives. That’s not that fundamentally different 
from a collective on a website deciding what to put up, except perhaps in 
terms of prestige politics. 

I think there’s certainly room for it and people do it. Blogging persists in 
various forms and remains useful to people. But there are limitations to self- 
publication. While I agree with many of Kathleen Fitzpatrick’s critiques of 
peer review, I also think peer review serves a tremendously useful function.? 
Academics aren’t always the best judges of our own work. One of the reasons 
why so much academic writing is hard to read is because we don’t edit each 
other very well and we don’t let ourselves be edited—people get so precious 
about their prose. For me, the thing that’s exciting about something like 
Sounding Out! is that it’s heavily edited and curated; it’s not blind-refereed but 
it’s certainly a kind of peer review that’s prior to dissemination. On one level 
you could call it self-publishing because it isn’t associated with a publisher, 
unless you call WordPress a publisher, which I guess they are in a certain 
sense. But, it’s also not the same thing as me putting something out there 
on my blog. 

The other problem is in how people are going to find things. Publish- 
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ers serve an important curatorial role and a promotional one, too. I do my 
best book shopping every year at conferences, especially in the wake of the 
collapse of most good academic bookstores. So, I like the idea of nonprofit 
academic publishing. The thing to remember about university presses is that 
they exist to lose money, just only a certain amount of money every year. I 
think they serve a useful purpose. If they suddenly disappeared, we’d have 
a lot more work to do, and we’d have a much harder time producing and 
finding our best work. And of course there are all sorts of bad behaviors 
protected and justified by so-called blind peer review which shouldn’t be 
allowed. Obviously there are many places we can improve, but I see self- 
publishing as part of a bigger ecology of publishing rather than a solution 
in itself. 


MCL Well, I think you got to publishing and a little bit about preservation, 
what about the other p—prestige? Thanks for editing our questions, by the 
way in your response. Well done [laughter]. 


Js Ifyou think about what makes publications matter, there’s the idealistic 
version that we all want to believe, at least I hope we do, which is that pub- 
lications matter when people read them. You want to be read; that’s what 
matters. I feel that this is the real test of digital humanities work. If people 
produce things that are really useful to other people, they’ll go find it. And 
they’ll use it, and they’ll cite it, and the fact that it wasn’t in the Journal of 
Highly Prestigious Things isn’t going to matter because the work will be in- 
fluential on its own.* But of course, there are all sorts of cases where people 
evaluate your publications without ever having read them or heard them or 
seen them, depending on what they are, and that’s where the whole prestige 
things comes in. So reviewers ask: “I haven’t read this piece, but is that a 
good journal?” Like that would tell you anything—crap gets into even the 
“best” journals! 

And that’s where one of the big blockages is right now with multimodal 
scholarship. You see it in written tenure requirements—where they exist. 
You see it in the questions framed in tenure review letters; and you see it 
when hiring committees look at the cvs of prospective applicants. In a bad 
job market, I tell DH people to show that they can do a little of both: you 
show that you can play by the rules and then you do it the way that you want 
to do it as well, and that’s probably the best that you can hope for. My job as 
someone reviewing a CV for a hire or tenure or whatever is to explain why 
and how digital work matters. For instance, people who write in TV studies 
will often publish in Flow, which is an online, multimodal periodical, so 
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when people publish there and I’m reviewing their files, Pll explain that this 
is actually an important place for their work to come out and it will probably 
be read and taught more than this other journal article in a more traditional 
outlet. So part of it is a matter of people who are being called upon to make 
judgments making the right judgments and explaining stuff to committees. 
It’s far from ideal. 

The other way you go is for organizations to specify sets of “best prac- 
tices,” which is what MLA is trying to do right now.’ That can work if you 
have enough motivated people who will then take those recommendations 
on board. In the humanities there’s a lot that has to be overcome—the 
single-authored article or book is still seen as the most basic unit of schol- 
arly production, and if your work suddenly turns collaborative, well, how’s 
that going to be evaluated? Is a hiring or tenure committee going to under- 
stand that? Hopefully, people doing collaborative work get hired with the 
understanding that they are expected to do what they already do. But people 
also change what they do. And so, we need to work to build institutional 
structures and traditions that support more kinds of scholarship. 

Part of it is just a matter of time and part of it is people citing each other, 
too. I think that’s really important. It’s interesting, for instance, to look at 
what digital projects are referenced in this book. Sharon Daniel and Erik 
Loyer’s “Public Secrets” and Emily Thompson’s “Roaring Twenties” are 
mentioned, although as of yet people are citing these pieces to say, “Hey, 
look, you can do cool things with sound studies in the digital domain.”® 
The next step is for people to cite work because of what it says as opposed to 
“Hey, now you can...” Like any other scholarship, digital humanities work 
needs to be able to travel beyond its own scholarly community. 


MCL I want to circle back a little bit to your point that what makes some- 
thing matter is whether or not it gets read. What about whether or not some- 
thing gets heard? I think this is a real problem for digital sound studies— 
and we talk a little about this in the introduction—people’s reluctance to 
spend time listening. There are so many cool things to listen to on our web 
collection, for example, but when I show them off to people they say, “Oh, 
cool.” But do they actually take the time to hear it? What do we need to do 
to get people to listen to digital scholarship? Is the burden on the creator to 
make it utterly compelling, or is ita larger cultural problem that needs to be 
addressed in a different way? 


JS It’s a huge challenge. Part of the problem is precisely the demand of du- 
ration. If you think about how people read scholarly books, there are those 
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who start on page 1 and finish on page 400. They might do it because they 
are going to stand up in front ofa class and talk about the text, or maybe they 
are really excited about the book, or it’s really close to their area of expertise, 
or if you are reviewing the book, one hopes anyway, that they read the whole 
thing. But that’s not the way it normally works. Normally, scholars don’t 
read books cover to cover, from beginning to end. We can say that people 
shouldn’t be engaging with scholarship superficially. But the reality is that 
we do it all the time when we are trying to write an essay and looking for a 
fact, or a way of talking about something, or a quote. The index at the back 
ofa print book is a tacit acknowledgment that people don’t read books from 
front to back. What would an index for academic soundworks look like? 
Think of it as a metadata problem. If the audio file were well tagged, you 
could find the part you need in the same way you can navigate a book. Then 
people could listen to the whole piece, or find parts as needed. As Jeremy 
Morris has shown, digital music didn’t take off online until the metadata 
problem was solved—I’m not sure why we would expect anything different 
for digital scholarship.’ 

I’m also curious about music information retrieval as another way into 
audio files, but in the short run it probably will be of more use to answer spe- 
cific questions, like, “Could you train a computer to hear music such that you 
could actually trace the diffusion of elements of style in popular music?” But 
we don’t know if that’s actually possible. One can imagine writing grants to 
study this sort of thing, studying it for years, and discovering that the an- 
swer is “no” [laughter]. But ifyou could do that, you could give a very different 
account of stylistic history, influence, and imitation, and other aspects of 
popular music history. That’s classic humanities territory. 


DM What you were just saying reminded me of something that I’ve been 
thinking about recently, which is this idea of close and distant reading, or 
big data versus microhistory, which we might kind of interpolate into close 
versus distant listening. It seems like with digital humanities there’s always 
this tension between the big data and the minutiae, and with humanities 
scholarship, there is the tendency toward looking at small details and ex- 
panding outward. I think that has been a central question for us; this ten- 
sion between the big and the small, the distant versus the close, has been 
something that’s come up again and again and again. 


JS Well, I mean one of the ironies when you're talking about sound is that 
both are more possible than they were before. To close-listen to something 
in 1990 at a university meant that you had to have a record player or a tape 
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deck in a classroom, which was unlikely. If you wanted your students to lis- 
ten to something, they had to go to a library to listen to it. You’d have to be 
pretty motivated if you weren’t in the music department. 

Close listening is a lot more possible today, and close analysis of audio 
is a lot more possible than it was even five or six years ago. That’s equally 
exciting to whatever big data possibilities exist. The commercial world, of 
course, is much more into the corpus question, recommendation engines, 
and so forth. Look at the new Apple music interface and the way they’re 
constantly trying to figure out how to refer bands and acts to one another. 


DM Like the music genome project that was the basis for Pandora. 


Js Yes. All of that is a kind of distant listening. Whether humanists want or 
need that kind of technology, or whether we can co-opt it for our purposes, I 
don’t know. It depends on how flexible the technology is. Academics did re- 
ally well at co-opting photocopiers and email, although email has co-opted 
us back now [laughter]. But sonically, we don’t know what it would mean to 
use it to analyze a corpus. One of the challenges with that stuff is not to ask 
such conservative questions like, you know, getting a bunch of orchestral 
music and saying, “Why is this the best music that has ever been made?” 


DM Yeah, tell me about it! Please, no more of that question. 


JS Yeah, that’s not a real research question, because you’ve basically said, 
“I want to use science to justify my aesthetic preferences.” It’s not going to 
happen. It rarely works in traditional humanities arguments—or at least I 
find those kinds of arguments completely beside the point of studying cul- 
ture. It certainly isn’t going to work when you need reproducible results. But 
the other challenge is that generating data itself is difficult. If you look at 
the brain science on hearing and music, a lot of it is done around very small 
sample sizes, because it’s expensive to do brain scans. So, I don’t know. I 
think we’re actually still a pretty long way away from any real advances in 
this area, because even though the tech industry thinks in very short time 
horizons, stuff for us changes really slowly, at the intellectual level. At the 
blink of an eye an institution can change, obviously, but intellectually I 
think it takes longer. And so a lot of what we have to do is figure out what 
questions we can ask with digital tools that actually might be useful to an- 
swer. And I think when that happens, that’s when these sorts of new meth- 
ods will really take off. 
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wT A lot of what we’ve talked about amongst ourselves is that we’re trying 
to bring sound into academic argumentation, and into academic practices 
of reading and writing—but in fact we need to bring academic practices of 
reading and writing a little bit more into sound in order to make audio mesh 
with scholarship. 


JS Absolutely. Part of the problem is that there are not well-developed aca- 
demic practices of listening outside of music and linguistics and a few other 
fields. Poetics is a really interesting example right now, because the field has 
become so much more sonically attuned in the last ten years—in part be- 
cause of the online sound archives and in part because of all the digital hu- 
manities research around it, and the continued burgeoning of performance 
studies and its impact on literary studies. Poetry is really a place where, in 
the space of a generation, scholars have rediscovered the importance of lis- 
tening and integrated it into their research and pedagogy. So it definitely can 
happen in other fields. 


DM It seems like you’re saying that the interplay between sound and text 
constantly finds ways of reinventing itself. People working on sound are al- 
ways confronting the issue of writing about sound in text. But as we found, 
even when building a website dedicated to sound, we were constantly being 
forced to deal with the fact that a digital medium is a visual medium as well. 
On the one hand, sound studies is very good at critiquing this dichotomy be- 
tween the linguistic and the aural; but I think at a different level, it’s also not 
so much about a textual bias as it is about recognizing that design has these 
biases built in. What can we do from there, other than just point to them? 


MCL For example, we felt frustrated by audio players being the primary 
mode for interacting with sound in digital spaces. It’s kind of an analogue 
notion, that you have this box and it has a play button, and pressing it is 
how you hear sound—it disallows a more intuitive, deeply integrated way of 
experiencing audio. At the same time, if you just have sound bursting out of 
the speakers without any stimulus, it’s really disruptive. Some of the more 
classic cultural biases a sound studies practitioner might address were very 
much embedded in the process of trying to design the website. 


JS The tyranny of the player is a thing. I’ve been thinking about this too— 
about what the “intuitive” modes of sonic representation are.* There is the 
wave form, which is amplitude. There is the spectrum, which is pitch versus 
amplitude, or frequency versus amplitude, which is supposed to represent 
timbre, but no one seems to be able to figure that out. There’s a very lim- 
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ited vocabulary for representing sound. If you go back fifteen years and you 
look at some of the really innovative work that was done in Flash by profes- 
sional companies for band websites (most of it is no longer available)—they 
found all sorts of ways of representing music. Of course, they conformed 
to no standard other that the Flash standard, which meant the site had to 
load; and if we’re talking about 2003 that took forever. But there was this 
moment of experimentation. And then people sort of gave up. There is a lot 
more power in HTMLS than in previous incarnations of the technology. 
You can basically build in plugins into your browser. So there is more that 
can be done. The kinds of vocal effects that are in Paperphone, the project 
by Umi Hsu and Jonathan Zorn in Provoke!—you can probably do that in a 
browser now.° 

The player solved a problem, though. When sound became part of the 
internet, it immediately became annoying, because its first uses were for 
advertising, right? Annoying things just started to play when going to a site, 
which is a problem if you are in an office, or ifyou are in any kind of collective 
space. It violates the privacy that you imagine exists between you and your 
screen, even if we know it never does. 

I don’t have a ready-made, how-to answer for it, but itseems that there are 
many other ways of representing sound and we might try some. I think the 
player is useful and works well when the sound is an example in a piece, like 
a figure or an illustration. And as for the analog tape recorder reference, it’s 
just classic skeuomorphic design combined with international standards. 
That right-facing triangle on the play button is part of an international stan- 
dard and somebody somewhere did sit down and say “this means play” in all 
languages. Engineers and designers use it as a kind of semaphoric language. 
So I don’t want to dismiss it either and say that an avant-garde strategy is 
automatically better, but it really depends on what you are trying to do. 


wT Maybewe should turn to this collection more specifically. Are there any 
particular pieces that resonate with you, or did you notice any overarching 
themes or trends that you found interesting? 


JS After reviewing the pieces, the first thing I did was make notes of all the 
different pedagogical suggestions that people have, because one of the great 
things about digital humanities work versus other fields is that people talk 
a lot more openly about pedagogy. I love teaching and I love talking about it, 
so it was actually really useful to see what others were doing in their classes. 
For the first time next winter [2016] I’m teaching a one-hundred-student un- 
dergrad lecture course in sound studies. I’m trying to figure out how many 
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crazy things to do within the timeframe and labor structures. . . . What can 
I do that will actually work and not force the course to collapse under its 
own weight? What can the Ta and I actually pull off? So the first thing I did 
when I finished reading the collection was open up my Evernote document 
that lists all the things I want to try in the class and I just added a bunch of 
suggestions from people’s essays. 

Zora Neale Hurston shows up a couple times (in essays by Myron Beasley 
and Regina Bradley). She’s kind of hot right now. Daphne Brooks has written 
about her, Roshi Kheshti’s new book also talks about her, and she keeps 
coming up at conferences I attend.” You always go back and reinvent your 
traditions, and she’s now this really useful figure for a lot of different, newly 
invented traditions, whether we’re talking about a sort of black feminist 
version of sound studies, or a digital humanities version of sound studies 
that’s more based in practice—you don’t just go out and record the songs, 
you also learn them yourself. And that’s how you know tradition. Of course, 
ethnomusicologists have been doing this for a long time. What’s different is 
that we’re imagining it for sonic practices beyond music making or songs. 
So Hurston is interesting because she’s a model of what’s possible and also 
because her relation to her subjects was not the traditional ethnographic 
relationship of the time. 

There’s a real emphasis on experience. Steph Ceraso goes furthest in 
actually talking about body consciousness and the centrality of experience 
in listening. But there’s a ton of that in the book implicitly, where people say, 
“I was only able to make sense of X because I experienced it in this way.” So 
I think it’s a really central-truth claim that’s made a lot around multimodal 
scholarship, around its epistemic promise. But it’s tremendously under- 
theorized. And Steph really went for it. Rich Rath does too. The great thing 
about Rich’s piece is, and this is true of all his work, is this wonderfully ten- 
der attention to alterity. He works to think with the other but not by trying 
to be or inhabit the other. He’s got that great line in the piece where he says 
there’s no such thing as absolute slavery, that’s a fantasy of the dominator, 
not the experience of the dominated. (I’m paraphrasing, of course.) That’s 
a pretty powerful argument to draw from your work, and it’s an interesting 
proposition. He sort of throws it out there because he’s trying to explain 
what he was doing in terms of audio production and making music and how 
that ties into history scholarship. But I think ultimately it’s arguments like 
that that we want to be pushing for in thinking about what digital human- 
ities scholarship can offer a broad audience. 

The only other obvious thing to point out is that most of the work dis- 
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cussed is collaborative—if not officially, then unofficially. You have people 
developing digital platforms, and even when they do it “by themselves,” they 
do it with other people. It seems like there is a real emphasis on process and 
the value of actually doing stuff sonically. I think the challenge is to artic- 
ulate that for people who don’t already buy the argument, and I don’t think 
anybody has succeeded yet. It’s a hard thing to do. I’m not exactly sure what 
I would say to someone who asks, “Well, why should I bother with it?” I’m 
not sure I could convince you if you weren’t already convinced, at least not 
without resorting to clichés that aren’t actually true, like claims about sound 
and duration. But it’s something we ought to think about. This is something 
I always push with sound studies in general. It isn’t just, “Oh, hey, sound is 
great, let’s study sound now”; but rather it’s our job to contribute back to 
the big intellectual, philosophical, empirical, political questions that are 
challenging scholars across the humanities and social sciences. You guys 
are just trying to figure out what the hell this digital sound studies thing is, 
what digital humanities and sound studies might be together, what can we 
actually get done, what can we do. But the long game of it for me is how will 
this carry the big conversation forward, and what can we do. You know, how 
can we transform other people’s minds. 


MCL That’s a good high watermark to aim for. That’s great. 
JS Yeah. I like ambitious [laughter]. 


MCL [really like that. So, I think that we take on a smaller task, which is to 
say, what sound studies brings to digital humanities and what digital hu- 
manities brings to sound studies, and why these two fields need to be in an 
explicit conversation with one another. I think the main thing that we think 
sound studies brings to digital humanities is an attention to culture, and 
I think what you were identifying in terms of Steph’s theorization of how 
and why we learn differently through sonic experiences, and that being in- 
tegral to all of this work—sound studies has a longer history of tying those 
kinds of insights to culture and history and really grounding them in, for 
instance, the history of technology, whereas digital humanities could do 
more to extend praxis into more deeply rooted humanistic research. And 
that’s not a criticism so much as just something that sound studies nicely 
brings. Like you were saying, on the one hand, sound studies isn’t just about, 
“Oh, sound’s cool, we should study it.” But on the other hand, sound is cool, 
and we should study it, and digital humanities could do more. There are im- 
plications for cultural productions that aren’t text-bound, and you’re reach- 
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ing more diverse intellectual traditions when you open research up to the 
sounded world. 


wT Similarly, along those lines, I think sound puts pressure on every single 
thing we’ve talked about, all the Ps: the prestige, publication, production, 
praxis, all of that. Sound brings something new to the conversation. And 
I think one of our goals was to try to demonstrate what that is. People are 
learning by playing with things that they’ve never played with before, things 
that they’ve never even been trained to address, and how do we bring that 
energy back into a traditional scholarly publishing economy. It’s especially 
true for sound, because this book is silent, it’s text-based—which gets back 
to this whole issue of how we bring listening practices into that, but also 
how do we bring reading and writing practices that are so well developed 
for good reasons within the humanities back to sound and sonic practice. I 
think that’s where we see our intervention. 


MCL So, Jonathan, are youjumping on the digital sound studies bandwagon? 


JS Wellsure, but with an asterisk. You say digital humanities is overwhelm- 
ingly visual, and I think absolutely, that’s incontrovertible. Although of 
course there are great examples of sonic work in digital humanities, and 
people in the field know that it’s an issue, too. So, obviously, there’s that 
dimension of it. I think you’re right that sound brings in different kinds 
of traditions, and different kinds of people—sound culture opens out into 
questions of race, gender, disability, and postcoloniality quite differently 
than visual culture. It can orient our research questions differently as well. 
But for me it is really driven by the questions rather than the methods or the 
tools. I can remember a time not so long ago when I said, “I will start using 
Powerpoint in my talks when I see five talks in a row with Powerpoint that 
doesn’t fail.” It was such a glitchy thing, and laptops were a lot less power- 
ful. We’ve come a long way. But there’s still more to be done. I have had to 
resort to a tech rider for my talks because, so often, basic audio setups don’t 
work in the places I go, even when they are supposed to. Playing audio off 
a computer, while seated, while talking, is still a tough demand for many 
academic settings. 

Perhaps unsurprisingly for someone who writes about technology, I am a 
bit of a gearhead. So it’s only reasonable that my own practice has continued 
in a multimodal direction that started back in my Bad Subjects days. In my 
talks now I often use Ableton Live as a presentation software: I do audio 
editing, I do video, and I’ve used it to solve access problems, too. A few years 
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back at the American Studies Association conference, I was on a sampling 
roundtable. It didn’t seem like they were going to be able to get me the ac- 
commodation that I needed, because I have this vocal cord impairment, and 
it is difficult for me to stand up and deliver a talk. So I just recorded my talk 
beforehand and performed it using Live and my laptop. Since the talk was on 
sampling, I made it entirely of samples. I just stood up there and performed 
without speaking in the moment—I delegated my speech to the device. And 
it solved the problem. Everybody thought it was this kind of high-concept 
performance, but actually it was just an elaborate disability accommodation 
in an environment that otherwise could not accommodate vocal differences 
of that sort. When I finished it, I didn’t know what to do with it. There was 
no obvious venue for something like that. But now, a revised version of that 
piece is going to come out as a publication in the online journal Intermedial- 
ities. Pm happy to be able to “put out the single,” as it were, even if it’s a bit 
less fun than the live show. 

But I will finish with my asterisk. When you say “digital sound studies 
bandwagon,” which I realize is meant with some humor, it does raise a 
deeper concern for me. There are a lot of digital humanities bandwagons 
at the moment. But what we need are deep and multidimensional infra- 
structures. All the things we discussed in this interview are at their base 
infrastructural concerns. We need technical infrastructures to support the 
specific work we want to do, like tagging and marking up an audio file in- 
side an electronic written text. We need institutional infrastructures to keep 
publications alive and running so their authors can abandon them. And 
we need cultural infrastructures where people develop and sustain more 
advanced techniques of listening to scholarship, as well as to the world, and 
where we better support one another’s intellectual forays into sound. Given 
the choice, I’d rather get on the infrastructure than on the bandwagon. 


NOTES 


1 The Auto-Tune piece has been folded into my [JS] book with Mara Mills, Tuning 
Time. This book will include all sorts of historical audio—talking books, ex- 
perimental time-stretching and time-compression recordings, pitch-shifting 
demos, snippets of musical works, modern examples, and we are still search- 
ing for a decent web audio player with markup for scholars. It does not seem to 
be anyone’s priority. 
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2 For example, see the Cost of Knowledge (accessed November 30, 2017, http:// 
thecostofknowledge.com). Resources for humanists to know their rights as 
authors include “Author Rights: Using the sparc Author Addendum” (ac- 
cessed November 30, 2017, www.sparc.arl.org/resources/authors/addendum). 
Publisher agreements are often littered with confusing—and sometimes 
illegal—legalistic language. As Sterne noted sometime after our conversation: 
“For example, recent contributor contracts from Princeton University Press 
and Palgrave have asked me to sign noncompete clauses (completely unnec- 
essary), to warrant that no processes in my text could be harmful to readers 
trying to reproduce them (unnecessary), to give up my moral rights (not legally 
possible in Canada), and allow them to assign the work to another author for 
revision and republication (just plain asinine).” Also see Striphas, “Acknowl- 
edged Goods.” 

3 Fitzpatrick, Planned Obsolescence. 

4 This is not an actual journal—at least not yet. 

5 See MLA, “Statement on Electronic Publication” (accessed November 30, 2017, 

www.mla.org/statement_on_publica). 

Thompson, “The Roaring Twenties,” and Daniel, “Public Secrets.” 

Morris, Selling Digital Music. 

See Sterne, “Player Hater.” 


Oo ON DB 


For more on Paperphone, see http://soundboxproject.com/project-paperphone 
-html (accessed January 15, 2018). 

10 Brooks, “Sister, Can You Line It Out?,” and Khesti, Modernity’s Ear. 

11 Sterne, “Through the Fog of Sonic Memory.” 
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